Detailed conclusion table per each integral is given by table below. The elapsed time is in seconds. For failed result it is given as F(-1) if the failure was due to timeout. It is given as F(-2) if the failure was due to an exception being raised, which could indicate a bug in the system. If the failure was due to integral not being evaluated within the time limit, then it is given just an F.
In this table,the column N.S. in the table below, which stands for normalized size is defined as \(\frac {\text {antiderivative leaf size}}{\text {optimal antiderivative leaf size}}\). To help make the table fit, Mathematica was abbreviated to MMA.
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1 | 1 | 1 | 2 | 1 | 1 | 0 | 1 | 1 | 1 |
| N.S. | 1 | 1.00 | 1.00 | 2.00 | 1.00 | 1.00 | 0.00 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.000 | 0.006 | 0.008 | 0.249 | 0.291 | 0.004 | 0.003 | 0.041 | 1.473 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1 | 1 | 1 | 2 | 1 | 1 | 0 | 1 | 1 | 1 |
| N.S. | 1 | 1.00 | 1.00 | 2.00 | 1.00 | 1.00 | 0.00 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.004 | 0.259 | 0.540 | 0.008 | 0.004 | 0.005 | 1.429 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 3 | 3 | 3 | 4 | 3 | 3 | 2 | 3 | 3 | 3 |
| N.S. | 1 | 1.00 | 1.00 | 1.33 | 1.00 | 1.00 | 0.67 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.001 | 0.000 | 0.005 | 0.243 | 0.294 | 0.007 | 0.003 | 0.006 | 1.517 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 3 | 3 | 3 | 4 | 3 | 3 | 3 | 4 | 3 | 3 |
| N.S. | 1 | 1.00 | 1.00 | 1.33 | 1.00 | 1.00 | 1.00 | 1.33 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.007 | 0.250 | 0.297 | 0.007 | 0.007 | 0.004 | 1.517 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 5 | 5 | 5 | 4 | 3 | 3 | 5 | 5 | 3 | 3 |
| N.S. | 1 | 1.00 | 1.00 | 0.80 | 0.60 | 0.60 | 1.00 | 1.00 | 0.60 | 0.60 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.006 | 0.243 | 0.284 | 0.008 | 0.009 | 0.008 | 1.491 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 3 | 3 | 3 | 4 | 3 | 3 | 2 | 3 | 3 | 3 |
| N.S. | 1 | 1.00 | 1.00 | 1.33 | 1.00 | 1.00 | 0.67 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.007 | 0.257 | 0.282 | 0.007 | 0.002 | 0.002 | 1.514 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 3 | 3 | 3 | 4 | 3 | 3 | 2 | 3 | 3 | 3 |
| N.S. | 1 | 1.00 | 1.00 | 1.33 | 1.00 | 1.00 | 0.67 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.008 | 0.252 | 0.266 | 0.007 | 0.001 | 0.002 | 1.486 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 4 | 4 | 4 | 5 | 4 | 4 | 3 | 4 | 4 | 4 |
| N.S. | 1 | 1.00 | 1.00 | 1.25 | 1.00 | 1.00 | 0.75 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.008 | 0.240 | 0.291 | 0.009 | 0.002 | 0.002 | 1.510 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 12 | 11 | 18 | 10 | 13 | 11 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.79 | 1.29 | 0.71 | 0.93 | 0.79 | 0.86 |
| time (sec) |
N/A | 0.005 | 0.000 | 0.022 | 0.237 | 0.295 | 0.024 | 0.003 | 0.003 | 1.563 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 7 | 7 | 7 | 6 | 5 | 5 | 3 | 6 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.71 | 0.71 | 0.43 | 0.86 | 0.71 | 0.71 |
| time (sec) |
N/A | 0.001 | 0.000 | 0.011 | 0.238 | 0.293 | 0.025 | 0.002 | 0.118 | 1.509 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 7 | 7 | 7 | 6 | 5 | 5 | 3 | 6 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.71 | 0.71 | 0.43 | 0.86 | 0.71 | 0.71 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.005 | 0.259 | 0.288 | 0.024 | 0.002 | 0.022 | 1.515 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 7 | 7 | 7 | 6 | 5 | 5 | 3 | 6 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.71 | 0.71 | 0.43 | 0.86 | 0.71 | 0.71 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.005 | 0.238 | 0.286 | 0.024 | 0.002 | 0.010 | 1.512 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 7 | 7 | 7 | 6 | 5 | 5 | 3 | 6 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.71 | 0.71 | 0.43 | 0.86 | 0.71 | 0.71 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.007 | 0.269 | 0.271 | 0.009 | 0.002 | 0.012 | 1.518 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1 | 1 | 1 | 2 | 1 | 1 | 0 | 1 | 1 | 1 |
| N.S. | 1 | 1.00 | 1.00 | 2.00 | 1.00 | 1.00 | 0.00 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.003 | 0.250 | 0.289 | 0.007 | 0.000 | 0.002 | 1.427 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 2 | 2 | 2 | 3 | 2 | 2 | 2 | 3 | 2 | 2 |
| N.S. | 1 | 1.00 | 1.00 | 1.50 | 1.00 | 1.00 | 1.00 | 1.50 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.005 | 0.265 | 0.301 | 0.026 | 0.003 | 0.036 | 1.425 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 5 | 5 | 5 | 6 | 5 | 5 | 3 | 3 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 1.20 | 1.00 | 1.00 | 0.60 | 0.60 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.007 | 0.257 | 0.288 | 0.026 | 0.002 | 0.035 | 1.502 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 7 | 7 | 7 | 6 | 5 | 5 | 7 | 7 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.71 | 0.71 | 1.00 | 1.00 | 0.71 | 0.71 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.009 | 0.257 | 0.289 | 0.027 | 0.002 | 0.014 | 1.503 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 7 | 7 | 7 | 6 | 5 | 5 | 7 | 7 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.71 | 0.71 | 1.00 | 1.00 | 0.71 | 0.71 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.007 | 0.255 | 0.288 | 0.027 | 0.002 | 0.012 | 1.516 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 7 | 7 | 7 | 6 | 5 | 5 | 7 | 7 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.71 | 0.71 | 1.00 | 1.00 | 0.71 | 0.71 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.025 | 0.265 | 0.305 | 0.027 | 0.002 | 0.070 | 1.526 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 9 | 9 | 9 | 6 | 5 | 5 | 7 | 12 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.67 | 0.56 | 0.56 | 0.78 | 1.33 | 0.56 | 0.56 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.020 | 0.245 | 0.591 | 0.027 | 0.001 | 0.077 | 1.525 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 9 | 9 | 9 | 6 | 5 | 5 | 7 | 12 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.67 | 0.56 | 0.56 | 0.78 | 1.33 | 0.56 | 0.56 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.016 | 0.242 | 0.299 | 0.027 | 0.001 | 0.031 | 1.523 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 9 | 9 | 9 | 6 | 5 | 5 | 7 | 10 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.67 | 0.56 | 0.56 | 0.78 | 1.11 | 0.56 | 0.56 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.017 | 0.244 | 0.291 | 0.026 | 0.000 | 0.029 | 1.512 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 7 | 7 | 7 | 6 | 5 | 5 | 5 | 7 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.71 | 0.71 | 0.71 | 1.00 | 0.71 | 0.71 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.017 | 0.259 | 0.293 | 0.026 | 0.000 | 0.031 | 1.499 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 7 | 7 | 7 | 6 | 5 | 5 | 7 | 9 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.71 | 0.71 | 1.00 | 1.29 | 0.71 | 0.71 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.017 | 0.249 | 0.289 | 0.027 | 0.000 | 0.031 | 1.519 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 9 | 9 | 9 | 6 | 5 | 5 | 8 | 13 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.67 | 0.56 | 0.56 | 0.89 | 1.44 | 0.56 | 0.56 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.020 | 0.243 | 0.295 | 0.027 | 0.000 | 0.034 | 1.497 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 9 | 9 | 9 | 6 | 5 | 5 | 7 | 16 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.67 | 0.56 | 0.56 | 0.78 | 1.78 | 0.56 | 0.56 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.019 | 0.266 | 0.305 | 0.026 | 0.001 | 0.073 | 1.521 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 9 | 9 | 9 | 6 | 5 | 5 | 7 | 12 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.67 | 0.56 | 0.56 | 0.78 | 1.33 | 0.56 | 0.56 |
| time (sec) |
N/A | 0.000 | 0.001 | 0.019 | 0.256 | 0.292 | 0.026 | 0.000 | 0.066 | 1.595 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 9 | 9 | 9 | 6 | 5 | 5 | 7 | 12 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.67 | 0.56 | 0.56 | 0.78 | 1.33 | 0.56 | 0.56 |
| time (sec) |
N/A | 0.000 | 0.001 | 0.027 | 0.245 | 0.294 | 0.027 | 0.000 | 0.065 | 1.560 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 9 | 9 | 9 | 6 | 5 | 5 | 7 | 10 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.67 | 0.56 | 0.56 | 0.78 | 1.11 | 0.56 | 0.56 |
| time (sec) |
N/A | 0.000 | 0.001 | 0.018 | 0.245 | 0.294 | 0.027 | 0.000 | 0.065 | 1.546 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 9 | 9 | 9 | 6 | 5 | 5 | 7 | 11 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.67 | 0.56 | 0.56 | 0.78 | 1.22 | 0.56 | 0.56 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.018 | 0.243 | 0.288 | 0.027 | 0.000 | 0.040 | 1.513 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 7 | 7 | 7 | 6 | 5 | 5 | 5 | 7 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.71 | 0.71 | 0.71 | 1.00 | 0.71 | 0.71 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.018 | 0.250 | 0.314 | 0.027 | 0.000 | 0.067 | 1.498 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 7 | 7 | 7 | 6 | 5 | 5 | 7 | 9 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.71 | 0.71 | 1.00 | 1.29 | 0.71 | 0.71 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.020 | 0.249 | 0.314 | 0.026 | 0.000 | 0.073 | 1.515 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 9 | 9 | 9 | 6 | 5 | 5 | 8 | 14 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.67 | 0.56 | 0.56 | 0.89 | 1.56 | 0.56 | 0.56 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.018 | 0.252 | 0.313 | 0.027 | 0.001 | 0.051 | 1.561 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 11 | 11 | 11 | 12 | 11 | 10 | 12 | 10 | 20 | 19 |
| N.S. | 1 | 1.00 | 1.00 | 1.09 | 1.00 | 0.91 | 1.09 | 0.91 | 1.82 | 1.73 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.007 | 0.244 | 0.314 | 0.028 | 0.000 | 0.345 | 1.583 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 12 | 17 | 16 | 12 | 17 | 14 | 12 | 0 |
| N.S. |
1 | 1.00 | 0.75 | 1.06 | 1.00 | 0.75 | 1.06 | 0.88 | 0.75 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.001 | 0.010 | 0.251 | 0.328 | 0.029 | 0.000 | 0.183 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 23 | 22 | 21 | 21 | 19 | 24 | 21 | 21 |
| N.S. | 1 | 1.00 | 1.00 | 0.96 | 0.91 | 0.91 | 0.83 | 1.04 | 0.91 | 0.91 |
| time (sec) |
N/A | 0.010 | 0.006 | 0.105 | 0.257 | 0.318 | 0.037 | 0.001 | 0.143 | 1.692 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 23 | 20 | 19 | 104 | 270 | 884 | 93 | 239 |
| N.S. | 1 | 1.00 | 1.00 | 0.87 | 0.83 | 4.52 | 11.74 | 38.43 | 4.04 | 10.39 |
| time (sec) |
N/A | 0.009 | 0.022 | 0.093 | 0.247 | 0.306 | 1.640 | 0.007 | 0.183 | 3.217 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 23 | 20 | 19 | 59 | 156 | 357 | 45 | 142 |
| N.S. | 1 | 1.00 | 1.00 | 0.87 | 0.83 | 2.57 | 6.78 | 15.52 | 1.96 | 6.17 |
| time (sec) |
N/A | 0.007 | 0.015 | 0.096 | 0.246 | 0.311 | 0.359 | 0.002 | 0.170 | 2.009 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 23 | 20 | 19 | 19 | 82 | 30 | 19 | 84 |
| N.S. | 1 | 1.00 | 1.00 | 0.87 | 0.83 | 0.83 | 3.57 | 1.30 | 0.83 | 3.65 |
| time (sec) |
N/A | 0.007 | 0.012 | 0.092 | 0.246 | 0.308 | 0.124 | 0.000 | 0.075 | 1.795 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 21 | 20 | 19 | 19 | 31 | 19 | 19 | 43 |
| N.S. | 1 | 1.00 | 1.00 | 0.95 | 0.90 | 0.90 | 1.48 | 0.90 | 0.90 | 2.05 |
| time (sec) |
N/A | 0.007 | 0.010 | 0.092 | 0.256 | 0.308 | 0.678 | 0.000 | 0.106 | 2.170 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 21 | 20 | 19 | 34 | 58 | 21 | 19 | 71 |
| N.S. | 1 | 1.00 | 1.00 | 0.95 | 0.90 | 1.62 | 2.76 | 1.00 | 0.90 | 3.38 |
| time (sec) |
N/A | 0.007 | 0.014 | 0.084 | 0.252 | 0.304 | 0.594 | 0.001 | 0.135 | 2.166 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 23 | 20 | 19 | 68 | 102 | 33 | 19 | 108 |
| N.S. | 1 | 1.00 | 1.00 | 0.87 | 0.83 | 2.96 | 4.43 | 1.43 | 0.83 | 4.70 |
| time (sec) |
N/A | 0.007 | 0.013 | 0.081 | 0.248 | 0.306 | 1.463 | 0.002 | 0.179 | 3.189 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 14 | 13 | 13 | 12 | 17 | 13 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.82 | 0.76 | 0.76 | 0.71 | 1.00 | 0.76 | 0.71 |
| time (sec) |
N/A | 0.007 | 0.001 | 0.011 | 0.246 | 0.301 | 0.027 | 0.000 | 0.020 | 1.624 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 14 | 13 | 13 | 12 | 17 | 13 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.82 | 0.76 | 0.76 | 0.71 | 1.00 | 0.76 | 0.71 |
| time (sec) |
N/A | 0.005 | 0.001 | 0.013 | 0.261 | 0.309 | 0.027 | 0.000 | 0.019 | 1.632 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 14 | 13 | 13 | 12 | 17 | 13 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.82 | 0.76 | 0.76 | 0.71 | 1.00 | 0.76 | 0.71 |
| time (sec) |
N/A | 0.004 | 0.001 | 0.010 | 0.258 | 0.268 | 0.027 | 0.000 | 0.019 | 1.608 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 12 | 12 | 12 | 11 | 10 | 10 | 8 | 11 | 10 | 10 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.83 | 0.83 | 0.67 | 0.92 | 0.83 | 0.83 |
| time (sec) |
N/A | 0.001 | 0.000 | 0.010 | 0.245 | 0.268 | 0.026 | 0.000 | 0.017 | 1.593 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 8 | 8 | 8 | 9 | 8 | 8 | 7 | 9 | 8 | 8 |
| N.S. | 1 | 1.00 | 1.00 | 1.12 | 1.00 | 1.00 | 0.88 | 1.12 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.002 | 0.001 | 0.012 | 0.246 | 0.323 | 0.040 | 0.000 | 0.017 | 1.588 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 11 | 11 | 11 | 12 | 11 | 13 | 7 | 11 | 11 | 11 |
| N.S. | 1 | 1.00 | 1.00 | 1.09 | 1.00 | 1.18 | 0.64 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.004 | 0.002 | 0.012 | 0.257 | 0.300 | 0.049 | 0.000 | 0.033 | 1.631 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 15 | 14 | 11 | 11 | 12 | 15 | 11 | 12 |
| N.S. | 1 | 1.00 | 0.88 | 0.82 | 0.65 | 0.65 | 0.71 | 0.88 | 0.65 | 0.71 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.010 | 0.247 | 0.304 | 0.053 | 0.000 | 0.023 | 1.627 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 14 | 13 | 13 | 14 | 17 | 13 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.82 | 0.76 | 0.76 | 0.82 | 1.00 | 0.76 | 0.71 |
| time (sec) |
N/A | 0.004 | 0.001 | 0.010 | 0.248 | 0.298 | 0.057 | 0.000 | 0.026 | 1.632 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 14 | 13 | 13 | 14 | 17 | 13 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.82 | 0.76 | 0.76 | 0.82 | 1.00 | 0.76 | 0.71 |
| time (sec) |
N/A | 0.003 | 0.001 | 0.011 | 0.251 | 0.311 | 0.062 | 0.000 | 0.027 | 1.678 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 25 | 24 | 24 | 26 | 30 | 24 | 24 |
| N.S. | 1 | 1.00 | 1.00 | 0.83 | 0.80 | 0.80 | 0.87 | 1.00 | 0.80 | 0.80 |
| time (sec) |
N/A | 0.009 | 0.001 | 0.071 | 0.254 | 0.301 | 0.032 | 0.000 | 0.077 | 1.680 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 25 | 24 | 24 | 24 | 30 | 24 | 23 |
| N.S. | 1 | 1.00 | 1.00 | 0.83 | 0.80 | 0.80 | 0.80 | 1.00 | 0.80 | 0.77 |
| time (sec) |
N/A | 0.007 | 0.001 | 0.074 | 0.246 | 0.307 | 0.031 | 0.000 | 0.031 | 1.659 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 25 | 24 | 24 | 26 | 30 | 24 | 24 |
| N.S. | 1 | 1.00 | 1.00 | 0.83 | 0.80 | 0.80 | 0.87 | 1.00 | 0.80 | 0.80 |
| time (sec) |
N/A | 0.007 | 0.001 | 0.069 | 0.248 | 0.301 | 0.031 | 0.000 | 0.030 | 1.646 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 20 | 20 | 19 | 12 | 20 | 18 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 1.43 | 1.43 | 1.36 | 0.86 | 1.43 | 1.29 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.087 | 0.247 | 0.300 | 0.030 | 0.000 | 0.029 | 1.733 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 22 | 21 | 20 | 20 | 20 | 23 | 20 | 20 |
| N.S. | 1 | 1.00 | 1.00 | 0.95 | 0.91 | 0.91 | 0.91 | 1.05 | 0.91 | 0.91 |
| time (sec) |
N/A | 0.005 | 0.001 | 0.072 | 0.255 | 0.298 | 0.048 | 0.000 | 0.029 | 1.745 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 20 | 21 | 20 | 24 | 17 | 20 | 20 | 22 |
| N.S. | 1 | 1.00 | 1.00 | 1.05 | 1.00 | 1.20 | 0.85 | 1.00 | 1.00 | 1.10 |
| time (sec) |
N/A | 0.006 | 0.000 | 0.073 | 0.248 | 0.310 | 0.059 | 0.000 | 0.066 | 1.726 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 24 | 24 | 24 | 23 | 21 | 26 | 22 | 27 | 23 | 22 |
| N.S. | 1 | 1.00 | 1.00 | 0.96 | 0.88 | 1.08 | 0.92 | 1.12 | 0.96 | 0.92 |
| time (sec) |
N/A | 0.006 | 0.002 | 0.078 | 0.246 | 0.305 | 0.075 | 0.000 | 0.044 | 1.800 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 26 | 25 | 22 | 22 | 24 | 27 | 22 | 23 |
| N.S. | 1 | 1.00 | 1.53 | 1.47 | 1.29 | 1.29 | 1.41 | 1.59 | 1.29 | 1.35 |
| time (sec) |
N/A | 0.001 | 0.004 | 0.072 | 0.244 | 0.298 | 0.079 | 0.000 | 0.035 | 1.765 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 25 | 24 | 24 | 26 | 29 | 24 | 24 |
| N.S. | 1 | 1.00 | 1.00 | 0.83 | 0.80 | 0.80 | 0.87 | 0.97 | 0.80 | 0.80 |
| time (sec) |
N/A | 0.006 | 0.002 | 0.073 | 0.246 | 0.325 | 0.085 | 0.000 | 0.035 | 1.721 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 25 | 24 | 24 | 26 | 29 | 24 | 23 |
| N.S. | 1 | 1.00 | 1.00 | 0.83 | 0.80 | 0.80 | 0.87 | 0.97 | 0.80 | 0.77 |
| time (sec) |
N/A | 0.006 | 0.004 | 0.084 | 0.264 | 0.309 | 0.105 | 0.000 | 0.035 | 1.751 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 25 | 24 | 24 | 26 | 29 | 24 | 24 |
| N.S. | 1 | 1.00 | 1.00 | 0.83 | 0.80 | 0.80 | 0.87 | 0.97 | 0.80 | 0.80 |
| time (sec) |
N/A | 0.006 | 0.002 | 0.086 | 0.247 | 0.312 | 0.119 | 0.000 | 0.034 | 1.769 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 25 | 24 | 24 | 26 | 29 | 24 | 23 |
| N.S. | 1 | 1.00 | 1.00 | 0.83 | 0.80 | 0.80 | 0.87 | 0.97 | 0.80 | 0.77 |
| time (sec) |
N/A | 0.006 | 0.004 | 0.087 | 0.254 | 0.302 | 0.107 | 0.000 | 0.036 | 1.779 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 43 | 36 | 35 | 35 | 37 | 43 | 35 | 35 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.81 | 0.81 | 0.86 | 1.00 | 0.81 | 0.81 |
| time (sec) |
N/A | 0.013 | 0.001 | 0.074 | 0.246 | 0.292 | 0.034 | 0.000 | 0.042 | 1.727 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 43 | 36 | 35 | 35 | 37 | 43 | 35 | 35 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.81 | 0.81 | 0.86 | 1.00 | 0.81 | 0.81 |
| time (sec) |
N/A | 0.012 | 0.001 | 0.070 | 0.255 | 0.298 | 0.033 | 0.000 | 0.041 | 1.761 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 43 | 36 | 35 | 35 | 39 | 43 | 35 | 35 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.81 | 0.81 | 0.91 | 1.00 | 0.81 | 0.81 |
| time (sec) |
N/A | 0.011 | 0.001 | 0.073 | 0.247 | 0.295 | 0.033 | 0.000 | 0.039 | 1.768 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 40 | 35 | 34 | 34 | 36 | 40 | 34 | 33 |
| N.S. | 1 | 1.00 | 1.33 | 1.17 | 1.13 | 1.13 | 1.20 | 1.33 | 1.13 | 1.10 |
| time (sec) |
N/A | 0.006 | 0.001 | 0.080 | 0.246 | 0.303 | 0.033 | 0.000 | 0.040 | 1.717 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 31 | 31 | 32 | 12 | 31 | 32 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 2.21 | 2.21 | 2.29 | 0.86 | 2.21 | 2.29 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.070 | 0.246 | 0.309 | 0.032 | 0.000 | 0.041 | 1.710 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 35 | 32 | 31 | 31 | 34 | 36 | 31 | 31 |
| N.S. | 1 | 1.00 | 1.00 | 0.91 | 0.89 | 0.89 | 0.97 | 1.03 | 0.89 | 0.89 |
| time (sec) |
N/A | 0.007 | 0.002 | 0.079 | 0.257 | 0.307 | 0.067 | 0.000 | 0.035 | 1.727 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 34 | 33 | 32 | 36 | 31 | 34 | 32 | 34 |
| N.S. | 1 | 1.00 | 1.00 | 0.97 | 0.94 | 1.06 | 0.91 | 1.00 | 0.94 | 1.00 |
| time (sec) |
N/A | 0.009 | 0.003 | 0.084 | 0.245 | 0.321 | 0.063 | 0.000 | 0.035 | 1.729 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 33 | 33 | 33 | 32 | 30 | 37 | 32 | 36 | 32 | 31 |
| N.S. | 1 | 1.00 | 1.00 | 0.97 | 0.91 | 1.12 | 0.97 | 1.09 | 0.97 | 0.94 |
| time (sec) |
N/A | 0.008 | 0.004 | 0.088 | 0.245 | 0.312 | 0.086 | 0.000 | 0.030 | 1.829 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 37 | 37 | 37 | 34 | 34 | 37 | 36 | 41 | 34 | 33 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.92 | 1.00 | 0.97 | 1.11 | 0.92 | 0.89 |
| time (sec) |
N/A | 0.009 | 0.003 | 0.086 | 0.243 | 0.298 | 0.101 | 0.000 | 0.071 | 1.878 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 39 | 36 | 33 | 33 | 36 | 39 | 33 | 34 |
| N.S. | 1 | 1.00 | 2.29 | 2.12 | 1.94 | 1.94 | 2.12 | 2.29 | 1.94 | 2.00 |
| time (sec) |
N/A | 0.001 | 0.002 | 0.073 | 0.255 | 0.303 | 0.108 | 0.000 | 0.026 | 1.852 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 41 | 36 | 35 | 35 | 37 | 41 | 34 | 34 |
| N.S. | 1 | 1.00 | 1.14 | 1.00 | 0.97 | 0.97 | 1.03 | 1.14 | 0.94 | 0.94 |
| time (sec) |
N/A | 0.004 | 0.004 | 0.073 | 0.247 | 0.308 | 0.117 | 0.000 | 0.027 | 1.860 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 43 | 36 | 35 | 35 | 37 | 41 | 35 | 35 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.81 | 0.81 | 0.86 | 0.95 | 0.81 | 0.81 |
| time (sec) |
N/A | 0.009 | 0.002 | 0.082 | 0.243 | 0.303 | 0.125 | 0.000 | 0.025 | 1.864 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 43 | 36 | 35 | 35 | 37 | 41 | 35 | 35 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.81 | 0.81 | 0.86 | 0.95 | 0.81 | 0.81 |
| time (sec) |
N/A | 0.009 | 0.002 | 0.088 | 0.250 | 0.294 | 0.134 | 0.000 | 0.026 | 1.861 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 66 | 57 | 56 | 56 | 63 | 66 | 56 | 57 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.85 | 0.85 | 0.95 | 1.00 | 0.85 | 0.86 |
| time (sec) |
N/A | 0.023 | 0.002 | 0.090 | 0.267 | 0.448 | 0.036 | 0.000 | 0.025 | 1.844 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 69 | 69 | 69 | 58 | 57 | 57 | 65 | 69 | 57 | 57 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.83 | 0.83 | 0.94 | 1.00 | 0.83 | 0.83 |
| time (sec) |
N/A | 0.019 | 0.002 | 0.073 | 0.250 | 0.300 | 0.036 | 0.000 | 0.023 | 1.840 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 69 | 69 | 69 | 58 | 57 | 57 | 66 | 69 | 57 | 57 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.83 | 0.83 | 0.96 | 1.00 | 0.83 | 0.83 |
| time (sec) |
N/A | 0.017 | 0.002 | 0.082 | 0.247 | 0.308 | 0.036 | 0.000 | 0.024 | 1.839 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 66 | 57 | 56 | 56 | 63 | 66 | 56 | 57 |
| N.S. | 1 | 1.00 | 1.03 | 0.89 | 0.88 | 0.88 | 0.98 | 1.03 | 0.88 | 0.89 |
| time (sec) |
N/A | 0.018 | 0.002 | 0.086 | 0.249 | 0.300 | 0.037 | 0.000 | 0.024 | 1.838 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 67 | 58 | 57 | 57 | 65 | 67 | 57 | 57 |
| N.S. | 1 | 1.00 | 1.43 | 1.23 | 1.21 | 1.21 | 1.38 | 1.43 | 1.21 | 1.21 |
| time (sec) |
N/A | 0.014 | 0.002 | 0.072 | 0.254 | 0.301 | 0.036 | 0.000 | 0.024 | 1.908 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 67 | 58 | 57 | 57 | 65 | 67 | 57 | 57 |
| N.S. | 1 | 1.00 | 2.23 | 1.93 | 1.90 | 1.90 | 2.17 | 2.23 | 1.90 | 1.90 |
| time (sec) |
N/A | 0.006 | 0.001 | 0.095 | 0.253 | 0.291 | 0.036 | 0.000 | 0.023 | 1.935 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 53 | 53 | 60 | 12 | 53 | 54 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 3.79 | 3.79 | 4.29 | 0.86 | 3.79 | 3.86 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.071 | 0.247 | 0.298 | 0.034 | 0.000 | 0.024 | 1.895 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 59 | 59 | 59 | 54 | 53 | 53 | 60 | 60 | 53 | 53 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.90 | 0.90 | 1.02 | 1.02 | 0.90 | 0.90 |
| time (sec) |
N/A | 0.012 | 0.002 | 0.085 | 0.245 | 0.313 | 0.063 | 0.000 | 0.029 | 1.908 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 58 | 55 | 54 | 59 | 56 | 58 | 54 | 57 |
| N.S. | 1 | 1.00 | 1.00 | 0.95 | 0.93 | 1.02 | 0.97 | 1.00 | 0.93 | 0.98 |
| time (sec) |
N/A | 0.014 | 0.003 | 0.095 | 0.251 | 0.311 | 0.073 | 0.000 | 0.029 | 1.899 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 60 | 60 | 60 | 55 | 53 | 59 | 60 | 63 | 55 | 56 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.88 | 0.98 | 1.00 | 1.05 | 0.92 | 0.93 |
| time (sec) |
N/A | 0.014 | 0.003 | 0.075 | 0.255 | 0.318 | 0.095 | 0.000 | 0.029 | 1.991 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 60 | 60 | 60 | 55 | 55 | 59 | 60 | 64 | 55 | 58 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.92 | 0.98 | 1.00 | 1.07 | 0.92 | 0.97 |
| time (sec) |
N/A | 0.014 | 0.003 | 0.098 | 0.252 | 0.311 | 0.117 | 0.000 | 0.039 | 2.055 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 57 | 54 | 54 | 59 | 58 | 62 | 54 | 53 |
| N.S. | 1 | 1.00 | 1.00 | 0.95 | 0.95 | 1.04 | 1.02 | 1.09 | 0.95 | 0.93 |
| time (sec) |
N/A | 0.014 | 0.004 | 0.095 | 0.249 | 0.298 | 0.145 | 0.000 | 0.077 | 2.121 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 61 | 56 | 56 | 59 | 60 | 65 | 56 | 58 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.92 | 0.97 | 0.98 | 1.07 | 0.92 | 0.95 |
| time (sec) |
N/A | 0.014 | 0.003 | 0.073 | 0.245 | 0.295 | 0.170 | 0.000 | 0.041 | 2.168 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 65 | 58 | 55 | 55 | 60 | 63 | 55 | 57 |
| N.S. | 1 | 1.00 | 3.82 | 3.41 | 3.24 | 3.24 | 3.53 | 3.71 | 3.24 | 3.35 |
| time (sec) |
N/A | 0.001 | 0.003 | 0.076 | 0.258 | 0.306 | 0.180 | 0.000 | 0.039 | 2.068 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 67 | 58 | 57 | 57 | 61 | 65 | 57 | 57 |
| N.S. | 1 | 1.00 | 1.86 | 1.61 | 1.58 | 1.58 | 1.69 | 1.81 | 1.58 | 1.58 |
| time (sec) |
N/A | 0.003 | 0.003 | 0.092 | 0.249 | 0.293 | 0.193 | 0.000 | 0.073 | 2.143 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 56 | 56 | 67 | 58 | 57 | 57 | 61 | 65 | 57 | 57 |
| N.S. | 1 | 1.00 | 1.20 | 1.04 | 1.02 | 1.02 | 1.09 | 1.16 | 1.02 | 1.02 |
| time (sec) |
N/A | 0.007 | 0.003 | 0.080 | 0.249 | 0.300 | 0.207 | 0.000 | 0.039 | 2.157 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 67 | 58 | 57 | 57 | 61 | 65 | 56 | 57 |
| N.S. | 1 | 1.00 | 1.00 | 0.87 | 0.85 | 0.85 | 0.91 | 0.97 | 0.84 | 0.85 |
| time (sec) |
N/A | 0.015 | 0.004 | 0.089 | 0.249 | 0.303 | 0.221 | 0.000 | 0.084 | 2.192 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 69 | 69 | 69 | 58 | 57 | 57 | 61 | 65 | 57 | 57 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.83 | 0.83 | 0.88 | 0.94 | 0.83 | 0.83 |
| time (sec) |
N/A | 0.015 | 0.003 | 0.088 | 0.256 | 0.300 | 0.231 | 0.000 | 0.082 | 2.169 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 69 | 69 | 69 | 58 | 57 | 57 | 61 | 65 | 57 | 57 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.83 | 0.83 | 0.88 | 0.94 | 0.83 | 0.83 |
| time (sec) |
N/A | 0.015 | 0.003 | 0.084 | 0.257 | 0.297 | 0.247 | 0.000 | 0.042 | 2.091 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 67 | 58 | 57 | 57 | 61 | 65 | 56 | 57 |
| N.S. | 1 | 1.00 | 1.00 | 0.87 | 0.85 | 0.85 | 0.91 | 0.97 | 0.84 | 0.85 |
| time (sec) |
N/A | 0.015 | 0.003 | 0.088 | 0.246 | 0.302 | 0.257 | 0.000 | 0.040 | 2.103 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 67 | 58 | 57 | 57 | 61 | 65 | 56 | 57 |
| N.S. | 1 | 1.00 | 1.00 | 0.87 | 0.85 | 0.85 | 0.91 | 0.97 | 0.84 | 0.85 |
| time (sec) |
N/A | 0.015 | 0.003 | 0.090 | 0.248 | 0.297 | 0.264 | 0.000 | 0.038 | 2.163 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 95 | 95 | 95 | 80 | 79 | 79 | 94 | 95 | 79 | 79 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.83 | 0.83 | 0.99 | 1.00 | 0.83 | 0.83 |
| time (sec) |
N/A | 0.033 | 0.002 | 0.091 | 0.256 | 0.307 | 0.040 | 0.000 | 0.153 | 1.979 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 95 | 95 | 95 | 80 | 79 | 79 | 92 | 95 | 79 | 79 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.83 | 0.83 | 0.97 | 1.00 | 0.83 | 0.83 |
| time (sec) |
N/A | 0.028 | 0.002 | 0.084 | 0.245 | 0.317 | 0.040 | 0.000 | 0.074 | 2.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 95 | 95 | 95 | 80 | 79 | 79 | 94 | 95 | 79 | 79 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.83 | 0.83 | 0.99 | 1.00 | 0.83 | 0.83 |
| time (sec) |
N/A | 0.025 | 0.002 | 0.089 | 0.245 | 0.293 | 0.040 | 0.000 | 0.068 | 1.991 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 96 | 96 | 92 | 79 | 78 | 78 | 90 | 92 | 78 | 79 |
| N.S. | 1 | 1.00 | 0.96 | 0.82 | 0.81 | 0.81 | 0.94 | 0.96 | 0.81 | 0.82 |
| time (sec) |
N/A | 0.027 | 0.002 | 0.073 | 0.243 | 0.302 | 0.040 | 0.000 | 0.060 | 2.115 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 93 | 80 | 79 | 79 | 92 | 93 | 79 | 79 |
| N.S. | 1 | 1.00 | 1.15 | 0.99 | 0.98 | 0.98 | 1.14 | 1.15 | 0.98 | 0.98 |
| time (sec) |
N/A | 0.023 | 0.002 | 0.072 | 0.247 | 0.305 | 0.039 | 0.000 | 0.062 | 2.039 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 93 | 80 | 79 | 79 | 92 | 93 | 79 | 79 |
| N.S. | 1 | 1.00 | 1.45 | 1.25 | 1.23 | 1.23 | 1.44 | 1.45 | 1.23 | 1.23 |
| time (sec) |
N/A | 0.020 | 0.002 | 0.094 | 0.252 | 0.316 | 0.039 | 0.000 | 0.104 | 2.055 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 93 | 80 | 79 | 79 | 92 | 93 | 31 | 79 |
| N.S. | 1 | 1.00 | 1.98 | 1.70 | 1.68 | 1.68 | 1.96 | 1.98 | 0.66 | 1.68 |
| time (sec) |
N/A | 0.016 | 0.002 | 0.076 | 0.244 | 0.298 | 0.039 | 0.000 | 0.121 | 2.003 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 91 | 80 | 79 | 79 | 90 | 91 | 25 | 79 |
| N.S. | 1 | 1.00 | 3.03 | 2.67 | 2.63 | 2.63 | 3.00 | 3.03 | 0.83 | 2.63 |
| time (sec) |
N/A | 0.006 | 0.002 | 0.100 | 0.248 | 0.614 | 0.038 | 0.000 | 0.115 | 1.967 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 75 | 83 | 12 | 75 | 76 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 5.36 | 5.93 | 0.86 | 5.36 | 5.43 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.075 | 0.246 | 0.298 | 0.036 | 0.000 | 0.060 | 1.972 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 87 | 87 | 87 | 76 | 75 | 75 | 88 | 88 | 75 | 75 |
| N.S. | 1 | 1.00 | 1.00 | 0.87 | 0.86 | 0.86 | 1.01 | 1.01 | 0.86 | 0.86 |
| time (sec) |
N/A | 0.018 | 0.002 | 0.079 | 0.265 | 0.307 | 0.072 | 0.000 | 0.072 | 1.943 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 86 | 86 | 86 | 77 | 76 | 81 | 85 | 86 | 76 | 79 |
| N.S. | 1 | 1.00 | 1.00 | 0.90 | 0.88 | 0.94 | 0.99 | 1.00 | 0.88 | 0.92 |
| time (sec) |
N/A | 0.021 | 0.003 | 0.079 | 0.246 | 0.299 | 0.081 | 0.000 | 0.055 | 2.003 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 84 | 77 | 75 | 81 | 85 | 87 | 77 | 78 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.89 | 0.96 | 1.01 | 1.04 | 0.92 | 0.93 |
| time (sec) |
N/A | 0.022 | 0.003 | 0.084 | 0.247 | 0.302 | 0.105 | 0.000 | 0.051 | 2.087 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 86 | 86 | 86 | 77 | 77 | 81 | 87 | 90 | 77 | 80 |
| N.S. | 1 | 1.00 | 1.00 | 0.90 | 0.90 | 0.94 | 1.01 | 1.05 | 0.90 | 0.93 |
| time (sec) |
N/A | 0.021 | 0.003 | 0.076 | 0.245 | 0.303 | 0.127 | 0.000 | 0.051 | 2.201 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 86 | 86 | 86 | 77 | 77 | 81 | 85 | 89 | 77 | 81 |
| N.S. | 1 | 1.00 | 1.00 | 0.90 | 0.90 | 0.94 | 0.99 | 1.03 | 0.90 | 0.94 |
| time (sec) |
N/A | 0.022 | 0.003 | 0.077 | 0.263 | 0.316 | 0.153 | 0.000 | 0.090 | 2.226 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 84 | 77 | 77 | 81 | 83 | 88 | 77 | 80 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.92 | 0.96 | 0.99 | 1.05 | 0.92 | 0.95 |
| time (sec) |
N/A | 0.021 | 0.003 | 0.079 | 0.270 | 0.301 | 0.193 | 0.000 | 0.106 | 2.284 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 85 | 85 | 85 | 76 | 76 | 81 | 82 | 86 | 81 | 80 |
| N.S. | 1 | 1.00 | 1.00 | 0.89 | 0.89 | 0.95 | 0.96 | 1.01 | 0.95 | 0.94 |
| time (sec) |
N/A | 0.021 | 0.004 | 0.077 | 0.260 | 0.307 | 0.227 | 0.001 | 0.110 | 2.324 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 89 | 89 | 89 | 78 | 78 | 81 | 83 | 89 | 78 | 80 |
| N.S. | 1 | 1.00 | 1.00 | 0.88 | 0.88 | 0.91 | 0.93 | 1.00 | 0.88 | 0.90 |
| time (sec) |
N/A | 0.021 | 0.003 | 0.091 | 0.246 | 0.299 | 0.257 | 0.000 | 0.068 | 2.381 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 87 | 80 | 77 | 77 | 83 | 87 | 77 | 79 |
| N.S. | 1 | 1.00 | 5.12 | 4.71 | 4.53 | 4.53 | 4.88 | 5.12 | 4.53 | 4.65 |
| time (sec) |
N/A | 0.001 | 0.003 | 0.074 | 0.260 | 0.305 | 0.269 | 0.000 | 0.067 | 2.354 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 91 | 80 | 79 | 79 | 85 | 89 | 23 | 79 |
| N.S. | 1 | 1.00 | 2.53 | 2.22 | 2.19 | 2.19 | 2.36 | 2.47 | 0.64 | 2.19 |
| time (sec) |
N/A | 0.004 | 0.003 | 0.073 | 0.248 | 0.294 | 0.286 | 0.000 | 0.093 | 2.295 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 56 | 56 | 93 | 80 | 79 | 79 | 85 | 89 | 79 | 79 |
| N.S. | 1 | 1.00 | 1.66 | 1.43 | 1.41 | 1.41 | 1.52 | 1.59 | 1.41 | 1.41 |
| time (sec) |
N/A | 0.007 | 0.003 | 0.073 | 0.248 | 0.337 | 0.309 | 0.000 | 0.109 | 2.285 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 76 | 76 | 93 | 80 | 79 | 79 | 85 | 89 | 79 | 79 |
| N.S. | 1 | 1.00 | 1.22 | 1.05 | 1.04 | 1.04 | 1.12 | 1.17 | 1.04 | 1.04 |
| time (sec) |
N/A | 0.012 | 0.003 | 0.079 | 0.250 | 0.298 | 0.326 | 0.001 | 0.106 | 2.278 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 96 | 96 | 93 | 80 | 79 | 79 | 85 | 89 | 79 | 79 |
| N.S. | 1 | 1.00 | 0.97 | 0.83 | 0.82 | 0.82 | 0.89 | 0.93 | 0.82 | 0.82 |
| time (sec) |
N/A | 0.019 | 0.003 | 0.075 | 0.263 | 0.295 | 0.340 | 0.000 | 0.066 | 2.376 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 93 | 93 | 93 | 80 | 79 | 79 | 85 | 89 | 78 | 79 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.85 | 0.85 | 0.91 | 0.96 | 0.84 | 0.85 |
| time (sec) |
N/A | 0.022 | 0.004 | 0.073 | 0.245 | 0.299 | 0.352 | 0.001 | 0.066 | 2.462 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 95 | 95 | 95 | 80 | 79 | 79 | 85 | 89 | 79 | 79 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.83 | 0.83 | 0.89 | 0.94 | 0.83 | 0.83 |
| time (sec) |
N/A | 0.022 | 0.003 | 0.077 | 0.248 | 0.305 | 0.368 | 0.000 | 0.070 | 2.683 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 95 | 95 | 95 | 80 | 79 | 79 | 85 | 89 | 79 | 79 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.83 | 0.83 | 0.89 | 0.94 | 0.83 | 0.83 |
| time (sec) |
N/A | 0.021 | 0.003 | 0.076 | 0.246 | 0.296 | 0.383 | 0.000 | 0.110 | 2.680 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 132 | 132 | 132 | 113 | 112 | 112 | 133 | 132 | 112 | 112 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.85 | 0.85 | 1.01 | 1.00 | 0.85 | 0.85 |
| time (sec) |
N/A | 0.051 | 0.002 | 0.078 | 0.254 | 0.301 | 0.045 | 0.000 | 0.150 | 2.142 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 132 | 132 | 132 | 113 | 112 | 112 | 131 | 132 | 112 | 112 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.85 | 0.85 | 0.99 | 1.00 | 0.85 | 0.85 |
| time (sec) |
N/A | 0.042 | 0.002 | 0.073 | 0.254 | 0.297 | 0.046 | 0.000 | 0.084 | 2.153 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 132 | 132 | 132 | 113 | 112 | 112 | 133 | 132 | 112 | 112 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.85 | 0.85 | 1.01 | 1.00 | 0.85 | 0.85 |
| time (sec) |
N/A | 0.041 | 0.002 | 0.075 | 0.252 | 0.306 | 0.045 | 0.000 | 0.125 | 2.167 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 147 | 147 | 125 | 112 | 111 | 111 | 126 | 125 | 111 | 112 |
| N.S. | 1 | 1.00 | 0.85 | 0.76 | 0.76 | 0.76 | 0.86 | 0.85 | 0.76 | 0.76 |
| time (sec) |
N/A | 0.043 | 0.002 | 0.091 | 0.258 | 0.305 | 0.045 | 0.000 | 0.087 | 2.298 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 132 | 132 | 130 | 113 | 112 | 112 | 131 | 130 | 112 | 112 |
| N.S. | 1 | 1.00 | 0.98 | 0.86 | 0.85 | 0.85 | 0.99 | 0.98 | 0.85 | 0.85 |
| time (sec) |
N/A | 0.038 | 0.002 | 0.075 | 0.266 | 0.298 | 0.044 | 0.000 | 0.082 | 2.331 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 112 | 112 | 126 | 113 | 112 | 112 | 128 | 126 | 112 | 112 |
| N.S. | 1 | 1.00 | 1.12 | 1.01 | 1.00 | 1.00 | 1.14 | 1.12 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.034 | 0.002 | 0.075 | 0.255 | 0.304 | 0.045 | 0.000 | 0.121 | 2.273 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 98 | 98 | 132 | 113 | 112 | 112 | 133 | 132 | 112 | 112 |
| N.S. | 1 | 1.00 | 1.35 | 1.15 | 1.14 | 1.14 | 1.36 | 1.35 | 1.14 | 1.14 |
| time (sec) |
N/A | 0.030 | 0.002 | 0.077 | 0.243 | 0.298 | 0.045 | 0.000 | 0.123 | 2.145 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 130 | 113 | 112 | 112 | 131 | 130 | 112 | 112 |
| N.S. | 1 | 1.00 | 1.60 | 1.40 | 1.38 | 1.38 | 1.62 | 1.60 | 1.38 | 1.38 |
| time (sec) |
N/A | 0.027 | 0.002 | 0.080 | 0.248 | 0.307 | 0.045 | 0.000 | 0.120 | 2.195 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 128 | 113 | 112 | 112 | 129 | 128 | 112 | 112 |
| N.S. | 1 | 1.00 | 2.00 | 1.77 | 1.75 | 1.75 | 2.02 | 2.00 | 1.75 | 1.75 |
| time (sec) |
N/A | 0.024 | 0.002 | 0.076 | 0.247 | 0.305 | 0.045 | 0.000 | 0.118 | 2.185 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 126 | 113 | 112 | 112 | 128 | 126 | 31 | 112 |
| N.S. | 1 | 1.00 | 2.68 | 2.40 | 2.38 | 2.38 | 2.72 | 2.68 | 0.66 | 2.38 |
| time (sec) |
N/A | 0.020 | 0.002 | 0.075 | 0.245 | 0.298 | 0.043 | 0.000 | 0.070 | 2.207 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 128 | 113 | 112 | 112 | 129 | 128 | 25 | 112 |
| N.S. | 1 | 1.00 | 4.27 | 3.77 | 3.73 | 3.73 | 4.30 | 4.27 | 0.83 | 3.73 |
| time (sec) |
N/A | 0.006 | 0.002 | 0.075 | 0.255 | 0.307 | 0.044 | 0.000 | 0.095 | 2.160 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 108 | 114 | 12 | 108 | 106 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 7.71 | 8.14 | 0.86 | 7.71 | 7.57 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.082 | 0.246 | 0.303 | 0.041 | 0.000 | 0.112 | 2.098 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 122 | 122 | 122 | 109 | 108 | 108 | 126 | 123 | 108 | 108 |
| N.S. | 1 | 1.00 | 1.00 | 0.89 | 0.89 | 0.89 | 1.03 | 1.01 | 0.89 | 0.89 |
| time (sec) |
N/A | 0.029 | 0.003 | 0.118 | 0.248 | 0.303 | 0.087 | 0.000 | 0.079 | 2.213 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 115 | 115 | 115 | 110 | 109 | 114 | 117 | 115 | 109 | 112 |
| N.S. | 1 | 1.00 | 1.00 | 0.96 | 0.95 | 0.99 | 1.02 | 1.00 | 0.95 | 0.97 |
| time (sec) |
N/A | 0.032 | 0.006 | 0.078 | 0.262 | 0.305 | 0.099 | 0.000 | 0.115 | 2.264 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 119 | 119 | 119 | 110 | 108 | 114 | 122 | 122 | 110 | 111 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.91 | 0.96 | 1.03 | 1.03 | 0.92 | 0.93 |
| time (sec) |
N/A | 0.031 | 0.003 | 0.096 | 0.243 | 0.303 | 0.121 | 0.001 | 0.071 | 2.352 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 115 | 115 | 115 | 110 | 108 | 114 | 119 | 119 | 110 | 111 |
| N.S. | 1 | 1.00 | 1.00 | 0.96 | 0.94 | 0.99 | 1.03 | 1.03 | 0.96 | 0.97 |
| time (sec) |
N/A | 0.032 | 0.006 | 0.077 | 0.246 | 0.306 | 0.145 | 0.000 | 0.062 | 2.400 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 119 | 119 | 119 | 110 | 110 | 114 | 121 | 122 | 110 | 113 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.92 | 0.96 | 1.02 | 1.03 | 0.92 | 0.95 |
| time (sec) |
N/A | 0.032 | 0.005 | 0.079 | 0.247 | 0.306 | 0.177 | 0.000 | 0.098 | 2.430 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 117 | 117 | 117 | 110 | 110 | 114 | 121 | 123 | 110 | 113 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 0.94 | 0.97 | 1.03 | 1.05 | 0.94 | 0.97 |
| time (sec) |
N/A | 0.032 | 0.006 | 0.078 | 0.259 | 0.303 | 0.217 | 0.000 | 0.099 | 2.441 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 119 | 119 | 119 | 110 | 110 | 114 | 122 | 126 | 110 | 113 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.92 | 0.96 | 1.03 | 1.06 | 0.92 | 0.95 |
| time (sec) |
N/A | 0.032 | 0.003 | 0.077 | 0.248 | 0.302 | 0.244 | 0.000 | 0.055 | 2.584 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 115 | 115 | 115 | 110 | 110 | 114 | 119 | 123 | 110 | 113 |
| N.S. | 1 | 1.00 | 1.00 | 0.96 | 0.96 | 0.99 | 1.03 | 1.07 | 0.96 | 0.98 |
| time (sec) |
N/A | 0.033 | 0.006 | 0.082 | 0.244 | 0.301 | 0.289 | 0.000 | 0.095 | 2.719 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 119 | 119 | 119 | 110 | 110 | 114 | 119 | 124 | 110 | 113 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.92 | 0.96 | 1.00 | 1.04 | 0.92 | 0.95 |
| time (sec) |
N/A | 0.032 | 0.003 | 0.076 | 0.250 | 0.306 | 0.330 | 0.000 | 0.068 | 2.796 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 114 | 114 | 114 | 109 | 109 | 114 | 117 | 122 | 114 | 113 |
| N.S. | 1 | 1.00 | 1.00 | 0.96 | 0.96 | 1.00 | 1.03 | 1.07 | 1.00 | 0.99 |
| time (sec) |
N/A | 0.032 | 0.004 | 0.082 | 0.261 | 0.301 | 0.381 | 0.001 | 0.076 | 2.832 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 124 | 124 | 124 | 111 | 111 | 114 | 119 | 125 | 111 | 113 |
| N.S. | 1 | 1.00 | 1.00 | 0.90 | 0.90 | 0.92 | 0.96 | 1.01 | 0.90 | 0.91 |
| time (sec) |
N/A | 0.032 | 0.003 | 0.077 | 0.244 | 0.302 | 0.420 | 0.001 | 0.074 | 2.874 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 114 | 113 | 110 | 110 | 119 | 123 | 110 | 111 |
| N.S. | 1 | 1.00 | 6.71 | 6.65 | 6.47 | 6.47 | 7.00 | 7.24 | 6.47 | 6.53 |
| time (sec) |
N/A | 0.001 | 0.006 | 0.080 | 0.244 | 0.294 | 0.442 | 0.000 | 0.134 | 2.793 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 128 | 113 | 112 | 112 | 121 | 125 | 23 | 112 |
| N.S. | 1 | 1.00 | 3.56 | 3.14 | 3.11 | 3.11 | 3.36 | 3.47 | 0.64 | 3.11 |
| time (sec) |
N/A | 0.004 | 0.003 | 0.075 | 0.243 | 0.297 | 0.472 | 0.000 | 0.096 | 2.767 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 56 | 56 | 126 | 113 | 112 | 112 | 121 | 125 | 112 | 112 |
| N.S. | 1 | 1.00 | 2.25 | 2.02 | 2.00 | 2.00 | 2.16 | 2.23 | 2.00 | 2.00 |
| time (sec) |
N/A | 0.008 | 0.006 | 0.075 | 0.255 | 0.303 | 0.493 | 0.001 | 0.132 | 2.922 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 76 | 76 | 128 | 113 | 112 | 112 | 121 | 125 | 112 | 112 |
| N.S. | 1 | 1.00 | 1.68 | 1.49 | 1.47 | 1.47 | 1.59 | 1.64 | 1.47 | 1.47 |
| time (sec) |
N/A | 0.012 | 0.005 | 0.075 | 0.244 | 0.304 | 0.507 | 0.001 | 0.094 | 2.909 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 96 | 96 | 130 | 113 | 112 | 112 | 121 | 125 | 112 | 112 |
| N.S. | 1 | 1.00 | 1.35 | 1.18 | 1.17 | 1.17 | 1.26 | 1.30 | 1.17 | 1.17 |
| time (sec) |
N/A | 0.019 | 0.006 | 0.078 | 0.246 | 0.302 | 0.562 | 0.000 | 0.130 | 2.881 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 116 | 116 | 132 | 113 | 112 | 112 | 121 | 125 | 112 | 112 |
| N.S. | 1 | 1.00 | 1.14 | 0.97 | 0.97 | 0.97 | 1.04 | 1.08 | 0.97 | 0.97 |
| time (sec) |
N/A | 0.026 | 0.003 | 0.085 | 0.252 | 0.301 | 0.584 | 0.001 | 0.135 | 2.900 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 126 | 113 | 112 | 112 | 121 | 125 | 112 | 112 |
| N.S. | 1 | 1.00 | 0.93 | 0.83 | 0.82 | 0.82 | 0.89 | 0.92 | 0.82 | 0.82 |
| time (sec) |
N/A | 0.035 | 0.006 | 0.090 | 0.245 | 0.291 | 0.593 | 0.001 | 0.134 | 2.937 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 130 | 130 | 130 | 113 | 112 | 112 | 121 | 125 | 112 | 112 |
| N.S. | 1 | 1.00 | 1.00 | 0.87 | 0.86 | 0.86 | 0.93 | 0.96 | 0.86 | 0.86 |
| time (sec) |
N/A | 0.033 | 0.003 | 0.076 | 0.248 | 0.303 | 0.607 | 0.001 | 0.099 | 2.931 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 126 | 126 | 126 | 113 | 112 | 112 | 121 | 125 | 111 | 112 |
| N.S. | 1 | 1.00 | 1.00 | 0.90 | 0.89 | 0.89 | 0.96 | 0.99 | 0.88 | 0.89 |
| time (sec) |
N/A | 0.032 | 0.005 | 0.076 | 0.244 | 0.304 | 0.633 | 0.001 | 0.137 | 2.999 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 14 | 13 | 13 | 12 | 12 | 13 | 11 | 11 |
| N.S. | 1 | 1.00 | 0.93 | 0.87 | 0.87 | 0.80 | 0.80 | 0.87 | 0.73 | 0.73 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.009 | 0.243 | 0.287 | 0.026 | 0.000 | 0.021 | 1.688 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 19 | 18 | 17 | 26 | 22 | 17 | 16 | 16 |
| N.S. | 1 | 1.00 | 0.95 | 0.90 | 0.85 | 1.30 | 1.10 | 0.85 | 0.80 | 0.80 |
| time (sec) |
N/A | 0.003 | 0.001 | 0.008 | 0.254 | 0.302 | 0.031 | 0.000 | 0.075 | 1.758 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 70 | 70 | 70 | 63 | 64 | 63 | 61 | 75 | 62 | 61 |
| N.S. | 1 | 1.00 | 1.00 | 0.90 | 0.91 | 0.90 | 0.87 | 1.07 | 0.89 | 0.87 |
| time (sec) |
N/A | 0.025 | 0.003 | 0.085 | 0.258 | 0.316 | 0.070 | 0.000 | 0.080 | 2.002 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 57 | 52 | 52 | 52 | 49 | 61 | 51 | 50 |
| N.S. | 1 | 1.00 | 1.00 | 0.91 | 0.91 | 0.91 | 0.86 | 1.07 | 0.89 | 0.88 |
| time (sec) |
N/A | 0.017 | 0.003 | 0.102 | 0.243 | 0.297 | 0.066 | 0.000 | 0.100 | 1.919 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 44 | 44 | 44 | 41 | 42 | 41 | 37 | 48 | 40 | 39 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.95 | 0.93 | 0.84 | 1.09 | 0.91 | 0.89 |
| time (sec) |
N/A | 0.014 | 0.003 | 0.084 | 0.242 | 0.324 | 0.062 | 0.000 | 0.038 | 1.843 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 31 | 31 | 31 | 30 | 29 | 29 | 26 | 34 | 29 | 28 |
| N.S. | 1 | 1.00 | 1.00 | 0.97 | 0.94 | 0.94 | 0.84 | 1.10 | 0.94 | 0.90 |
| time (sec) |
N/A | 0.010 | 0.002 | 0.077 | 0.244 | 0.316 | 0.057 | 0.000 | 0.039 | 1.755 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 18 | 18 | 18 | 19 | 18 | 17 | 14 | 19 | 18 | 17 |
| N.S. | 1 | 1.00 | 1.00 | 1.06 | 1.00 | 0.94 | 0.78 | 1.06 | 1.00 | 0.94 |
| time (sec) |
N/A | 0.007 | 0.002 | 0.076 | 0.254 | 0.301 | 0.050 | 0.000 | 0.076 | 1.696 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 10 | 10 | 10 | 11 | 10 | 10 | 7 | 10 | 10 | 10 |
| N.S. | 1 | 1.00 | 1.00 | 1.10 | 1.00 | 1.00 | 0.70 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.078 | 0.243 | 0.298 | 0.029 | 0.000 | 0.021 | 1.627 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 18 | 18 | 18 | 19 | 18 | 16 | 10 | 21 | 15 | 17 |
| N.S. | 1 | 1.00 | 1.00 | 1.06 | 1.00 | 0.89 | 0.56 | 1.17 | 0.83 | 0.94 |
| time (sec) |
N/A | 0.003 | 0.003 | 0.082 | 0.244 | 0.305 | 0.071 | 0.000 | 0.085 | 1.803 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 28 | 29 | 28 | 26 | 19 | 37 | 25 | 30 |
| N.S. | 1 | 1.00 | 1.00 | 1.04 | 1.00 | 0.93 | 0.68 | 1.32 | 0.89 | 1.07 |
| time (sec) |
N/A | 0.010 | 0.003 | 0.077 | 0.241 | 0.311 | 0.089 | 0.000 | 0.051 | 1.877 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 42 | 42 | 42 | 41 | 40 | 41 | 31 | 52 | 38 | 42 |
| N.S. | 1 | 1.00 | 1.00 | 0.98 | 0.95 | 0.98 | 0.74 | 1.24 | 0.90 | 1.00 |
| time (sec) |
N/A | 0.012 | 0.003 | 0.082 | 0.252 | 0.315 | 0.104 | 0.000 | 0.058 | 1.944 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 56 | 56 | 56 | 53 | 51 | 54 | 44 | 66 | 48 | 53 |
| N.S. | 1 | 1.00 | 1.00 | 0.95 | 0.91 | 0.96 | 0.79 | 1.18 | 0.86 | 0.95 |
| time (sec) |
N/A | 0.016 | 0.004 | 0.086 | 0.243 | 0.319 | 0.115 | 0.000 | 0.105 | 2.122 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 68 | 63 | 62 | 65 | 56 | 77 | 60 | 64 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.91 | 0.96 | 0.82 | 1.13 | 0.88 | 0.94 |
| time (sec) |
N/A | 0.018 | 0.003 | 0.088 | 0.244 | 0.302 | 0.131 | 0.001 | 0.065 | 2.204 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 77 | 78 | 82 | 96 | 78 | 92 | 83 | 98 |
| N.S. | 1 | 1.00 | 0.95 | 0.96 | 1.01 | 1.19 | 0.96 | 1.14 | 1.02 | 1.21 |
| time (sec) |
N/A | 0.036 | 0.014 | 0.082 | 0.244 | 0.317 | 0.117 | 0.000 | 0.140 | 2.257 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 66 | 68 | 70 | 85 | 71 | 82 | 72 | 89 |
| N.S. | 1 | 1.00 | 0.92 | 0.94 | 0.97 | 1.18 | 0.99 | 1.14 | 1.00 | 1.24 |
| time (sec) |
N/A | 0.030 | 0.010 | 0.084 | 0.251 | 0.304 | 0.112 | 0.000 | 0.070 | 2.215 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 54 | 57 | 59 | 73 | 54 | 67 | 62 | 72 |
| N.S. | 1 | 1.00 | 0.93 | 0.98 | 1.02 | 1.26 | 0.93 | 1.16 | 1.07 | 1.24 |
| time (sec) |
N/A | 0.024 | 0.011 | 0.082 | 0.246 | 0.307 | 0.104 | 0.000 | 0.067 | 2.129 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 46 | 46 | 43 | 46 | 47 | 62 | 44 | 53 | 50 | 54 |
| N.S. | 1 | 1.00 | 0.93 | 1.00 | 1.02 | 1.35 | 0.96 | 1.15 | 1.09 | 1.17 |
| time (sec) |
N/A | 0.019 | 0.008 | 0.084 | 0.246 | 0.303 | 0.095 | 0.000 | 0.079 | 2.107 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 33 | 33 | 29 | 34 | 36 | 47 | 31 | 37 | 36 | 39 |
| N.S. | 1 | 1.00 | 0.88 | 1.03 | 1.09 | 1.42 | 0.94 | 1.12 | 1.09 | 1.18 |
| time (sec) |
N/A | 0.013 | 0.008 | 0.089 | 0.244 | 0.293 | 0.086 | 0.000 | 0.081 | 1.967 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 20 | 24 | 26 | 28 | 20 | 25 | 23 | 25 |
| N.S. | 1 | 1.00 | 0.87 | 1.04 | 1.13 | 1.22 | 0.87 | 1.09 | 1.00 | 1.09 |
| time (sec) |
N/A | 0.009 | 0.004 | 0.081 | 0.257 | 0.301 | 0.067 | 0.000 | 0.036 | 1.911 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 12 | 12 | 12 | 13 | 12 | 13 | 10 | 9 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 1.08 | 1.00 | 1.08 | 0.83 | 0.75 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.001 | 0.002 | 0.077 | 0.248 | 0.310 | 0.065 | 0.000 | 0.029 | 1.723 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 24 | 30 | 28 | 39 | 22 | 37 | 26 | 34 |
| N.S. | 1 | 1.00 | 0.83 | 1.03 | 0.97 | 1.34 | 0.76 | 1.28 | 0.90 | 1.17 |
| time (sec) |
N/A | 0.011 | 0.008 | 0.084 | 0.248 | 0.316 | 0.106 | 0.000 | 0.122 | 1.916 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 42 | 42 | 35 | 43 | 45 | 63 | 37 | 52 | 45 | 49 |
| N.S. | 1 | 1.00 | 0.83 | 1.02 | 1.07 | 1.50 | 0.88 | 1.24 | 1.07 | 1.17 |
| time (sec) |
N/A | 0.016 | 0.022 | 0.091 | 0.245 | 0.309 | 0.132 | 0.000 | 0.120 | 2.102 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 53 | 57 | 64 | 86 | 54 | 71 | 57 | 65 |
| N.S. | 1 | 1.00 | 0.91 | 0.98 | 1.10 | 1.48 | 0.93 | 1.22 | 0.98 | 1.12 |
| time (sec) |
N/A | 0.020 | 0.028 | 0.087 | 0.243 | 0.322 | 0.150 | 0.001 | 0.110 | 2.266 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 69 | 69 | 66 | 68 | 73 | 95 | 66 | 84 | 69 | 76 |
| N.S. | 1 | 1.00 | 0.96 | 0.99 | 1.06 | 1.38 | 0.96 | 1.22 | 1.00 | 1.10 |
| time (sec) |
N/A | 0.025 | 0.030 | 0.083 | 0.254 | 0.301 | 0.169 | 0.001 | 0.080 | 2.351 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 79 | 79 | 86 | 108 | 80 | 96 | 79 | 87 |
| N.S. | 1 | 1.00 | 0.94 | 0.94 | 1.02 | 1.29 | 0.95 | 1.14 | 0.94 | 1.04 |
| time (sec) |
N/A | 0.030 | 0.024 | 0.091 | 0.246 | 0.320 | 0.184 | 0.001 | 0.116 | 2.460 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 99 | 99 | 89 | 94 | 103 | 129 | 109 | 109 | 91 | 138 |
| N.S. | 1 | 1.00 | 0.90 | 0.95 | 1.04 | 1.30 | 1.10 | 1.10 | 0.92 | 1.39 |
| time (sec) |
N/A | 0.049 | 0.015 | 0.095 | 0.249 | 0.300 | 0.182 | 0.001 | 0.234 | 2.494 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 86 | 86 | 77 | 83 | 91 | 117 | 92 | 92 | 78 | 126 |
| N.S. | 1 | 1.00 | 0.90 | 0.97 | 1.06 | 1.36 | 1.07 | 1.07 | 0.91 | 1.47 |
| time (sec) |
N/A | 0.037 | 0.015 | 0.085 | 0.271 | 0.303 | 0.170 | 0.000 | 0.158 | 2.389 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 77 | 77 | 67 | 72 | 81 | 107 | 85 | 86 | 67 | 116 |
| N.S. | 1 | 1.00 | 0.87 | 0.94 | 1.05 | 1.39 | 1.10 | 1.12 | 0.87 | 1.51 |
| time (sec) |
N/A | 0.031 | 0.012 | 0.085 | 0.268 | 0.311 | 0.164 | 0.001 | 0.124 | 2.330 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 55 | 62 | 69 | 95 | 70 | 70 | 54 | 107 |
| N.S. | 1 | 1.00 | 0.86 | 0.97 | 1.08 | 1.48 | 1.09 | 1.09 | 0.84 | 1.67 |
| time (sec) |
N/A | 0.024 | 0.010 | 0.096 | 0.246 | 0.320 | 0.151 | 0.001 | 0.078 | 2.243 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 50 | 50 | 40 | 49 | 57 | 83 | 58 | 53 | 43 | 80 |
| N.S. | 1 | 1.00 | 0.80 | 0.98 | 1.14 | 1.66 | 1.16 | 1.06 | 0.86 | 1.60 |
| time (sec) |
N/A | 0.019 | 0.023 | 0.085 | 0.248 | 0.296 | 0.138 | 0.001 | 0.146 | 2.147 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 33 | 40 | 48 | 61 | 46 | 41 | 46 | 57 |
| N.S. | 1 | 1.00 | 0.80 | 0.98 | 1.17 | 1.49 | 1.12 | 1.00 | 1.12 | 1.39 |
| time (sec) |
N/A | 0.014 | 0.008 | 0.083 | 0.244 | 0.311 | 0.104 | 0.001 | 0.093 | 2.065 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 20 | 27 | 32 | 32 | 32 | 22 | 32 | 30 |
| N.S. | 1 | 1.00 | 1.18 | 1.59 | 1.88 | 1.88 | 1.88 | 1.29 | 1.88 | 1.76 |
| time (sec) |
N/A | 0.001 | 0.003 | 0.085 | 0.260 | 0.300 | 0.096 | 0.000 | 0.072 | 1.847 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 24 | 26 | 12 | 26 | 23 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 1.71 | 1.86 | 0.86 | 1.86 | 1.64 |
| time (sec) |
N/A | 0.001 | 0.002 | 0.087 | 0.246 | 0.299 | 0.095 | 0.000 | 0.068 | 1.763 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 37 | 42 | 51 | 80 | 46 | 52 | 43 | 66 |
| N.S. | 1 | 1.00 | 0.86 | 0.98 | 1.19 | 1.86 | 1.07 | 1.21 | 1.00 | 1.53 |
| time (sec) |
N/A | 0.015 | 0.016 | 0.095 | 0.246 | 0.318 | 0.154 | 0.001 | 0.100 | 2.202 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 53 | 56 | 69 | 109 | 66 | 73 | 63 | 83 |
| N.S. | 1 | 1.00 | 0.93 | 0.98 | 1.21 | 1.91 | 1.16 | 1.28 | 1.11 | 1.46 |
| time (sec) |
N/A | 0.020 | 0.028 | 0.086 | 0.244 | 0.303 | 0.185 | 0.001 | 0.114 | 2.339 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 76 | 76 | 68 | 73 | 86 | 130 | 78 | 82 | 79 | 98 |
| N.S. | 1 | 1.00 | 0.89 | 0.96 | 1.13 | 1.71 | 1.03 | 1.08 | 1.04 | 1.29 |
| time (sec) |
N/A | 0.027 | 0.026 | 0.090 | 0.270 | 0.309 | 0.197 | 0.001 | 0.119 | 2.498 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 89 | 89 | 79 | 84 | 97 | 141 | 92 | 100 | 91 | 109 |
| N.S. | 1 | 1.00 | 0.89 | 0.94 | 1.09 | 1.58 | 1.03 | 1.12 | 1.02 | 1.22 |
| time (sec) |
N/A | 0.031 | 0.037 | 0.092 | 0.247 | 0.305 | 0.218 | 0.001 | 0.128 | 2.711 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 97 | 97 | 90 | 94 | 108 | 152 | 102 | 107 | 101 | 120 |
| N.S. | 1 | 1.00 | 0.93 | 0.97 | 1.11 | 1.57 | 1.05 | 1.10 | 1.04 | 1.24 |
| time (sec) |
N/A | 0.037 | 0.030 | 0.085 | 0.255 | 0.313 | 0.233 | 0.001 | 0.092 | 2.851 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 114 | 114 | 101 | 109 | 125 | 162 | 131 | 120 | 103 | 177 |
| N.S. | 1 | 1.00 | 0.89 | 0.96 | 1.10 | 1.42 | 1.15 | 1.05 | 0.90 | 1.55 |
| time (sec) |
N/A | 0.061 | 0.019 | 0.085 | 0.245 | 0.317 | 0.253 | 0.001 | 0.370 | 2.857 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 105 | 105 | 90 | 99 | 114 | 151 | 119 | 106 | 90 | 166 |
| N.S. | 1 | 1.00 | 0.86 | 0.94 | 1.09 | 1.44 | 1.13 | 1.01 | 0.86 | 1.58 |
| time (sec) |
N/A | 0.050 | 0.016 | 0.097 | 0.266 | 0.300 | 0.242 | 0.001 | 0.221 | 2.776 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 90 | 90 | 90 | 87 | 102 | 139 | 107 | 96 | 79 | 154 |
| N.S. | 1 | 1.00 | 1.00 | 0.97 | 1.13 | 1.54 | 1.19 | 1.07 | 0.88 | 1.71 |
| time (sec) |
N/A | 0.042 | 0.012 | 0.085 | 0.272 | 0.306 | 0.224 | 0.001 | 0.153 | 2.621 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 68 | 77 | 91 | 129 | 94 | 81 | 66 | 86 |
| N.S. | 1 | 1.00 | 0.84 | 0.95 | 1.12 | 1.59 | 1.16 | 1.00 | 0.81 | 1.06 |
| time (sec) |
N/A | 0.034 | 0.014 | 0.084 | 0.245 | 0.315 | 0.210 | 0.001 | 0.125 | 2.537 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 51 | 64 | 79 | 116 | 82 | 65 | 55 | 74 |
| N.S. | 1 | 1.00 | 0.78 | 0.98 | 1.22 | 1.78 | 1.26 | 1.00 | 0.85 | 1.14 |
| time (sec) |
N/A | 0.026 | 0.025 | 0.084 | 0.264 | 0.305 | 0.196 | 0.001 | 0.173 | 2.432 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 44 | 55 | 70 | 94 | 70 | 50 | 45 | 90 |
| N.S. | 1 | 1.00 | 0.76 | 0.95 | 1.21 | 1.62 | 1.21 | 0.86 | 0.78 | 1.55 |
| time (sec) |
N/A | 0.021 | 0.009 | 0.081 | 0.269 | 0.294 | 0.150 | 0.001 | 0.070 | 2.320 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 31 | 41 | 54 | 54 | 56 | 34 | 56 | 52 |
| N.S. | 1 | 1.00 | 1.82 | 2.41 | 3.18 | 3.18 | 3.29 | 2.00 | 3.29 | 3.06 |
| time (sec) |
N/A | 0.001 | 0.007 | 0.090 | 0.250 | 0.305 | 0.130 | 0.000 | 0.085 | 2.087 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 20 | 27 | 43 | 43 | 44 | 22 | 44 | 42 |
| N.S. | 1 | 1.00 | 0.67 | 0.90 | 1.43 | 1.43 | 1.47 | 0.73 | 1.47 | 1.40 |
| time (sec) |
N/A | 0.010 | 0.003 | 0.079 | 0.243 | 0.304 | 0.124 | 0.000 | 0.072 | 2.005 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 35 | 37 | 12 | 37 | 34 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 2.50 | 2.64 | 0.86 | 2.64 | 2.43 |
| time (sec) |
N/A | 0.001 | 0.002 | 0.080 | 0.246 | 0.305 | 0.121 | 0.000 | 0.077 | 1.950 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 48 | 54 | 73 | 124 | 70 | 63 | 60 | 99 |
| N.S. | 1 | 1.00 | 0.84 | 0.95 | 1.28 | 2.18 | 1.23 | 1.11 | 1.05 | 1.74 |
| time (sec) |
N/A | 0.020 | 0.019 | 0.085 | 0.296 | 0.306 | 0.194 | 0.001 | 0.128 | 2.516 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 70 | 70 | 64 | 69 | 91 | 153 | 90 | 85 | 85 | 116 |
| N.S. | 1 | 1.00 | 0.91 | 0.99 | 1.30 | 2.19 | 1.29 | 1.21 | 1.21 | 1.66 |
| time (sec) |
N/A | 0.028 | 0.034 | 0.091 | 0.268 | 0.309 | 0.238 | 0.001 | 0.084 | 2.712 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 93 | 93 | 79 | 88 | 108 | 174 | 104 | 97 | 101 | 131 |
| N.S. | 1 | 1.00 | 0.85 | 0.95 | 1.16 | 1.87 | 1.12 | 1.04 | 1.09 | 1.41 |
| time (sec) |
N/A | 0.033 | 0.032 | 0.085 | 0.267 | 0.312 | 0.250 | 0.001 | 0.136 | 2.906 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 102 | 102 | 88 | 99 | 117 | 183 | 114 | 105 | 113 | 142 |
| N.S. | 1 | 1.00 | 0.86 | 0.97 | 1.15 | 1.79 | 1.12 | 1.03 | 1.11 | 1.39 |
| time (sec) |
N/A | 0.039 | 0.031 | 0.085 | 0.255 | 0.313 | 0.266 | 0.001 | 0.104 | 2.956 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 117 | 117 | 101 | 110 | 130 | 196 | 128 | 120 | 123 | 153 |
| N.S. | 1 | 1.00 | 0.86 | 0.94 | 1.11 | 1.68 | 1.09 | 1.03 | 1.05 | 1.31 |
| time (sec) |
N/A | 0.049 | 0.037 | 0.087 | 0.269 | 0.311 | 0.278 | 0.001 | 0.173 | 3.115 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 150 | 150 | 139 | 144 | 180 | 250 | 190 | 139 | 126 | 283 |
| N.S. | 1 | 1.00 | 0.93 | 0.96 | 1.20 | 1.67 | 1.27 | 0.93 | 0.84 | 1.89 |
| time (sec) |
N/A | 0.095 | 0.016 | 0.091 | 0.246 | 0.297 | 0.459 | 0.001 | 1.086 | 3.734 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 139 | 139 | 128 | 132 | 169 | 239 | 180 | 134 | 115 | 272 |
| N.S. | 1 | 1.00 | 0.92 | 0.95 | 1.22 | 1.72 | 1.29 | 0.96 | 0.83 | 1.96 |
| time (sec) |
N/A | 0.077 | 0.018 | 0.105 | 0.265 | 0.311 | 0.436 | 0.001 | 0.553 | 3.613 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 128 | 128 | 104 | 122 | 157 | 228 | 165 | 114 | 102 | 152 |
| N.S. | 1 | 1.00 | 0.81 | 0.95 | 1.23 | 1.78 | 1.29 | 0.89 | 0.80 | 1.19 |
| time (sec) |
N/A | 0.063 | 0.025 | 0.087 | 0.255 | 0.297 | 0.410 | 0.001 | 0.179 | 3.384 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 118 | 118 | 104 | 109 | 145 | 215 | 153 | 101 | 91 | 140 |
| N.S. | 1 | 1.00 | 0.88 | 0.92 | 1.23 | 1.82 | 1.30 | 0.86 | 0.77 | 1.19 |
| time (sec) |
N/A | 0.052 | 0.017 | 0.087 | 0.263 | 0.314 | 0.377 | 0.001 | 0.336 | 3.371 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 109 | 109 | 77 | 100 | 136 | 193 | 141 | 83 | 81 | 189 |
| N.S. | 1 | 1.00 | 0.71 | 0.92 | 1.25 | 1.77 | 1.29 | 0.76 | 0.74 | 1.73 |
| time (sec) |
N/A | 0.045 | 0.013 | 0.083 | 0.252 | 0.313 | 0.302 | 0.001 | 0.106 | 3.203 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 64 | 87 | 120 | 120 | 128 | 70 | 72 | 119 |
| N.S. | 1 | 1.00 | 3.76 | 5.12 | 7.06 | 7.06 | 7.53 | 4.12 | 4.24 | 7.00 |
| time (sec) |
N/A | 0.001 | 0.006 | 0.082 | 0.250 | 0.305 | 0.279 | 0.001 | 0.122 | 2.715 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 53 | 72 | 109 | 109 | 116 | 58 | 22 | 108 |
| N.S. | 1 | 1.00 | 1.51 | 2.06 | 3.11 | 3.11 | 3.31 | 1.66 | 0.63 | 3.09 |
| time (sec) |
N/A | 0.004 | 0.006 | 0.082 | 0.258 | 0.306 | 0.252 | 0.001 | 0.072 | 2.626 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 52 | 64 | 42 | 57 | 98 | 98 | 104 | 46 | 48 | 97 |
| N.S. | 1 | 1.23 | 0.81 | 1.10 | 1.88 | 1.88 | 2.00 | 0.88 | 0.92 | 1.87 |
| time (sec) |
N/A | 0.022 | 0.006 | 0.084 | 0.246 | 0.311 | 0.234 | 0.001 | 0.068 | 2.473 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 31 | 42 | 87 | 87 | 92 | 34 | 31 | 86 |
| N.S. | 1 | 1.00 | 0.66 | 0.89 | 1.85 | 1.85 | 1.96 | 0.72 | 0.66 | 1.83 |
| time (sec) |
N/A | 0.016 | 0.005 | 0.081 | 0.249 | 0.306 | 0.220 | 0.001 | 0.080 | 2.365 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 20 | 27 | 76 | 76 | 80 | 22 | 18 | 75 |
| N.S. | 1 | 1.00 | 0.67 | 0.90 | 2.53 | 2.53 | 2.67 | 0.73 | 0.60 | 2.50 |
| time (sec) |
N/A | 0.010 | 0.004 | 0.082 | 0.241 | 0.302 | 0.209 | 0.001 | 0.100 | 2.429 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 68 | 73 | 12 | 70 | 67 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 4.86 | 5.21 | 0.86 | 5.00 | 4.79 |
| time (sec) |
N/A | 0.001 | 0.002 | 0.080 | 0.244 | 0.297 | 0.209 | 0.000 | 0.064 | 2.319 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 99 | 99 | 81 | 90 | 139 | 256 | 141 | 96 | 102 | 198 |
| N.S. | 1 | 1.00 | 0.82 | 0.91 | 1.40 | 2.59 | 1.42 | 0.97 | 1.03 | 2.00 |
| time (sec) |
N/A | 0.036 | 0.034 | 0.090 | 0.248 | 0.313 | 0.326 | 0.001 | 0.455 | 3.202 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 117 | 117 | 97 | 108 | 157 | 285 | 162 | 121 | 151 | 215 |
| N.S. | 1 | 1.00 | 0.83 | 0.92 | 1.34 | 2.44 | 1.38 | 1.03 | 1.29 | 1.84 |
| time (sec) |
N/A | 0.054 | 0.051 | 0.088 | 0.269 | 0.326 | 0.374 | 0.001 | 0.186 | 3.423 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 144 | 144 | 112 | 133 | 174 | 306 | 175 | 130 | 167 | 230 |
| N.S. | 1 | 1.00 | 0.78 | 0.92 | 1.21 | 2.12 | 1.22 | 0.90 | 1.16 | 1.60 |
| time (sec) |
N/A | 0.065 | 0.038 | 0.086 | 0.261 | 0.308 | 0.391 | 0.001 | 0.209 | 3.526 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 157 | 157 | 123 | 144 | 185 | 317 | 187 | 148 | 179 | 241 |
| N.S. | 1 | 1.00 | 0.78 | 0.92 | 1.18 | 2.02 | 1.19 | 0.94 | 1.14 | 1.54 |
| time (sec) |
N/A | 0.075 | 0.052 | 0.107 | 0.258 | 0.313 | 0.410 | 0.001 | 0.311 | 3.592 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 186 | 186 | 161 | 177 | 234 | 338 | 250 | 168 | 151 | 229 |
| N.S. | 1 | 1.00 | 0.87 | 0.95 | 1.26 | 1.82 | 1.34 | 0.90 | 0.81 | 1.23 |
| time (sec) |
N/A | 0.125 | 0.025 | 0.086 | 0.280 | 0.303 | 0.706 | 0.001 | 0.979 | 4.291 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 177 | 177 | 150 | 167 | 223 | 327 | 236 | 147 | 138 | 218 |
| N.S. | 1 | 1.00 | 0.85 | 0.94 | 1.26 | 1.85 | 1.33 | 0.83 | 0.78 | 1.23 |
| time (sec) |
N/A | 0.102 | 0.016 | 0.101 | 0.266 | 0.317 | 0.674 | 0.001 | 0.227 | 4.196 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 159 | 159 | 137 | 154 | 211 | 314 | 224 | 137 | 127 | 206 |
| N.S. | 1 | 1.00 | 0.86 | 0.97 | 1.33 | 1.97 | 1.41 | 0.86 | 0.80 | 1.30 |
| time (sec) |
N/A | 0.085 | 0.018 | 0.097 | 0.275 | 0.312 | 0.621 | 0.001 | 0.943 | 4.070 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 154 | 154 | 111 | 145 | 202 | 292 | 212 | 116 | 117 | 288 |
| N.S. | 1 | 1.00 | 0.72 | 0.94 | 1.31 | 1.90 | 1.38 | 0.75 | 0.76 | 1.87 |
| time (sec) |
N/A | 0.074 | 0.018 | 0.085 | 0.249 | 0.311 | 0.517 | 0.001 | 0.187 | 3.858 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 97 | 131 | 186 | 186 | 199 | 106 | 107 | 185 |
| N.S. | 1 | 1.00 | 5.71 | 7.71 | 10.94 | 10.94 | 11.71 | 6.24 | 6.29 | 10.88 |
| time (sec) |
N/A | 0.001 | 0.011 | 0.082 | 0.273 | 0.310 | 0.477 | 0.001 | 0.141 | 3.324 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 86 | 117 | 175 | 175 | 187 | 94 | 22 | 174 |
| N.S. | 1 | 1.00 | 2.46 | 3.34 | 5.00 | 5.00 | 5.34 | 2.69 | 0.63 | 4.97 |
| time (sec) |
N/A | 0.004 | 0.008 | 0.083 | 0.267 | 0.318 | 0.432 | 0.001 | 0.126 | 3.145 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 52 | 52 | 75 | 102 | 164 | 164 | 175 | 82 | 85 | 163 |
| N.S. | 1 | 1.00 | 1.44 | 1.96 | 3.15 | 3.15 | 3.37 | 1.58 | 1.63 | 3.13 |
| time (sec) |
N/A | 0.007 | 0.009 | 0.090 | 0.259 | 0.298 | 0.401 | 0.001 | 0.140 | 3.215 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 69 | 69 | 64 | 86 | 153 | 153 | 163 | 70 | 71 | 152 |
| N.S. | 1 | 1.00 | 0.93 | 1.25 | 2.22 | 2.22 | 2.36 | 1.01 | 1.03 | 2.20 |
| time (sec) |
N/A | 0.011 | 0.008 | 0.083 | 0.245 | 0.307 | 0.369 | 0.001 | 0.078 | 3.025 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 53 | 72 | 142 | 142 | 151 | 58 | 61 | 141 |
| N.S. | 1 | 1.00 | 0.65 | 0.89 | 1.75 | 1.75 | 1.86 | 0.72 | 0.75 | 1.74 |
| time (sec) |
N/A | 0.028 | 0.008 | 0.085 | 0.269 | 0.313 | 0.349 | 0.001 | 0.077 | 2.895 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 42 | 57 | 131 | 131 | 139 | 46 | 48 | 130 |
| N.S. | 1 | 1.00 | 0.66 | 0.89 | 2.05 | 2.05 | 2.17 | 0.72 | 0.75 | 2.03 |
| time (sec) |
N/A | 0.022 | 0.005 | 0.084 | 0.250 | 0.308 | 0.325 | 0.001 | 0.127 | 2.799 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 31 | 42 | 120 | 120 | 128 | 34 | 31 | 119 |
| N.S. | 1 | 1.00 | 0.66 | 0.89 | 2.55 | 2.55 | 2.72 | 0.72 | 0.66 | 2.53 |
| time (sec) |
N/A | 0.016 | 0.006 | 0.095 | 0.253 | 0.310 | 0.312 | 0.001 | 0.150 | 2.747 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 20 | 27 | 109 | 109 | 116 | 22 | 18 | 108 |
| N.S. | 1 | 1.00 | 0.67 | 0.90 | 3.63 | 3.63 | 3.87 | 0.73 | 0.60 | 3.60 |
| time (sec) |
N/A | 0.010 | 0.004 | 0.085 | 0.270 | 0.313 | 0.298 | 0.001 | 0.067 | 2.640 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 101 | 109 | 12 | 103 | 100 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 7.21 | 7.79 | 0.86 | 7.36 | 7.14 |
| time (sec) |
N/A | 0.001 | 0.002 | 0.089 | 0.263 | 0.297 | 0.307 | 0.000 | 0.141 | 2.567 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 141 | 141 | 127 | 126 | 205 | 388 | 212 | 129 | 145 | 297 |
| N.S. | 1 | 1.00 | 0.90 | 0.89 | 1.45 | 2.75 | 1.50 | 0.91 | 1.03 | 2.11 |
| time (sec) |
N/A | 0.053 | 0.056 | 0.091 | 0.276 | 0.316 | 0.461 | 0.001 | 0.762 | 3.997 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 158 | 158 | 130 | 147 | 223 | 417 | 233 | 157 | 217 | 314 |
| N.S. | 1 | 1.00 | 0.82 | 0.93 | 1.41 | 2.64 | 1.47 | 0.99 | 1.37 | 1.99 |
| time (sec) |
N/A | 0.088 | 0.072 | 0.087 | 0.257 | 0.317 | 0.528 | 0.001 | 0.395 | 4.167 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 191 | 191 | 145 | 178 | 240 | 438 | 246 | 163 | 233 | 329 |
| N.S. | 1 | 1.00 | 0.76 | 0.93 | 1.26 | 2.29 | 1.29 | 0.85 | 1.22 | 1.72 |
| time (sec) |
N/A | 0.105 | 0.061 | 0.094 | 0.282 | 0.321 | 0.542 | 0.001 | 0.438 | 4.336 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 198 | 198 | 156 | 189 | 251 | 449 | 258 | 184 | 245 | 340 |
| N.S. | 1 | 1.00 | 0.79 | 0.95 | 1.27 | 2.27 | 1.30 | 0.93 | 1.24 | 1.72 |
| time (sec) |
N/A | 0.115 | 0.070 | 0.136 | 0.276 | 0.323 | 0.559 | 0.001 | 0.586 | 4.319 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 141 | 141 | 141 | 132 | 132 | 136 | 143 | 147 | 132 | 135 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 0.94 | 0.96 | 1.01 | 1.04 | 0.94 | 0.96 |
| time (sec) |
N/A | 0.054 | 0.007 | 0.083 | 0.259 | 0.314 | 0.401 | 0.001 | 0.081 | 2.828 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 132 | 132 | 132 | 121 | 121 | 125 | 131 | 136 | 121 | 124 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.92 | 0.95 | 0.99 | 1.03 | 0.92 | 0.94 |
| time (sec) |
N/A | 0.047 | 0.004 | 0.087 | 0.268 | 0.316 | 0.388 | 0.001 | 0.092 | 2.740 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 114 | 114 | 114 | 109 | 109 | 114 | 117 | 122 | 114 | 113 |
| N.S. | 1 | 1.00 | 1.00 | 0.96 | 0.96 | 1.00 | 1.03 | 1.07 | 1.00 | 0.99 |
| time (sec) |
N/A | 0.038 | 0.004 | 0.077 | 0.245 | 0.313 | 0.387 | 0.000 | 0.002 | 2.683 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 109 | 109 | 109 | 100 | 100 | 103 | 107 | 113 | 100 | 102 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.92 | 0.94 | 0.98 | 1.04 | 0.92 | 0.94 |
| time (sec) |
N/A | 0.035 | 0.003 | 0.077 | 0.248 | 0.314 | 0.368 | 0.001 | 0.082 | 2.654 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 96 | 91 | 88 | 88 | 95 | 99 | 88 | 90 |
| N.S. | 1 | 1.00 | 5.65 | 5.35 | 5.18 | 5.18 | 5.59 | 5.82 | 5.18 | 5.29 |
| time (sec) |
N/A | 0.001 | 0.006 | 0.084 | 0.273 | 0.301 | 0.325 | 0.000 | 0.090 | 2.284 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 91 | 80 | 79 | 79 | 85 | 89 | 23 | 79 |
| N.S. | 1 | 1.00 | 2.53 | 2.22 | 2.19 | 2.19 | 2.36 | 2.47 | 0.64 | 2.19 |
| time (sec) |
N/A | 0.004 | 0.003 | 0.074 | 0.262 | 0.303 | 0.286 | 0.000 | 0.002 | 2.249 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 56 | 56 | 80 | 69 | 68 | 68 | 73 | 77 | 68 | 68 |
| N.S. | 1 | 1.00 | 1.43 | 1.23 | 1.21 | 1.21 | 1.30 | 1.38 | 1.21 | 1.21 |
| time (sec) |
N/A | 0.008 | 0.005 | 0.082 | 0.254 | 0.316 | 0.255 | 0.000 | 0.098 | 2.176 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 67 | 58 | 57 | 57 | 61 | 65 | 56 | 57 |
| N.S. | 1 | 1.00 | 1.00 | 0.87 | 0.85 | 0.85 | 0.91 | 0.97 | 0.84 | 0.85 |
| time (sec) |
N/A | 0.017 | 0.004 | 0.073 | 0.244 | 0.303 | 0.217 | 0.000 | 0.002 | 2.023 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 56 | 56 | 56 | 47 | 46 | 46 | 49 | 53 | 46 | 46 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.82 | 0.82 | 0.88 | 0.95 | 0.82 | 0.82 |
| time (sec) |
N/A | 0.013 | 0.005 | 0.076 | 0.254 | 0.306 | 0.186 | 0.000 | 0.035 | 1.923 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 43 | 36 | 35 | 35 | 37 | 41 | 35 | 35 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.81 | 0.81 | 0.86 | 0.95 | 0.81 | 0.81 |
| time (sec) |
N/A | 0.010 | 0.003 | 0.076 | 0.243 | 0.302 | 0.148 | 0.000 | 0.032 | 1.824 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 25 | 24 | 24 | 26 | 29 | 24 | 23 |
| N.S. | 1 | 1.00 | 1.00 | 0.83 | 0.80 | 0.80 | 0.87 | 0.97 | 0.80 | 0.77 |
| time (sec) |
N/A | 0.007 | 0.004 | 0.084 | 0.270 | 0.303 | 0.115 | 0.000 | 0.036 | 1.729 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 14 | 13 | 13 | 14 | 17 | 13 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.82 | 0.76 | 0.76 | 0.82 | 1.00 | 0.76 | 0.71 |
| time (sec) |
N/A | 0.004 | 0.001 | 0.012 | 0.243 | 0.304 | 0.081 | 0.000 | 0.029 | 1.644 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 7 | 7 | 7 | 6 | 5 | 5 | 7 | 7 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.71 | 0.71 | 1.00 | 1.00 | 0.71 | 0.71 |
| time (sec) |
N/A | 0.000 | 0.000 | 0.007 | 0.258 | 0.299 | 0.027 | 0.000 | 0.020 | 1.531 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 134 | 134 | 134 | 119 | 117 | 120 | 116 | 135 | 114 | 119 |
| N.S. | 1 | 1.00 | 1.00 | 0.89 | 0.87 | 0.90 | 0.87 | 1.01 | 0.85 | 0.89 |
| time (sec) |
N/A | 0.040 | 0.004 | 0.089 | 0.256 | 0.316 | 0.194 | 0.001 | 0.127 | 2.661 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 146 | 146 | 134 | 135 | 141 | 163 | 139 | 155 | 135 | 142 |
| N.S. | 1 | 1.00 | 0.92 | 0.92 | 0.97 | 1.12 | 0.95 | 1.06 | 0.92 | 0.97 |
| time (sec) |
N/A | 0.061 | 0.052 | 0.089 | 0.268 | 0.315 | 0.270 | 0.001 | 0.083 | 2.955 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 163 | 163 | 145 | 150 | 163 | 207 | 163 | 169 | 157 | 175 |
| N.S. | 1 | 1.00 | 0.89 | 0.92 | 1.00 | 1.27 | 1.00 | 1.04 | 0.96 | 1.07 |
| time (sec) |
N/A | 0.075 | 0.059 | 0.089 | 0.268 | 0.306 | 0.340 | 0.001 | 0.228 | 3.197 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 14 | 13 | 13 | 12 | 18 | 10 | 11 |
| N.S. | 1 | 1.00 | 1.00 | 0.82 | 0.76 | 0.76 | 0.71 | 1.06 | 0.59 | 0.65 |
| time (sec) |
N/A | 0.002 | 0.002 | 0.086 | 0.250 | 0.304 | 0.054 | 0.000 | 0.170 | 1.605 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 14 | 13 | 13 | 12 | 18 | 10 | 11 |
| N.S. | 1 | 1.00 | 1.00 | 0.82 | 0.76 | 0.76 | 0.71 | 1.06 | 0.59 | 0.65 |
| time (sec) |
N/A | 0.002 | 0.002 | 0.091 | 0.242 | 0.314 | 0.053 | 0.000 | 0.143 | 1.612 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 24 | 24 | 24 | 19 | 18 | 21 | 20 | 27 | 18 | 19 |
| N.S. | 1 | 1.00 | 1.00 | 0.79 | 0.75 | 0.88 | 0.83 | 1.12 | 0.75 | 0.79 |
| time (sec) |
N/A | 0.007 | 0.002 | 0.091 | 0.239 | 0.302 | 0.059 | 0.001 | 0.054 | 1.656 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 31 | 31 | 31 | 24 | 23 | 28 | 26 | 32 | 18 | 24 |
| N.S. | 1 | 1.00 | 1.00 | 0.77 | 0.74 | 0.90 | 0.84 | 1.03 | 0.58 | 0.77 |
| time (sec) |
N/A | 0.007 | 0.002 | 0.092 | 0.241 | 0.309 | 0.062 | 0.000 | 0.037 | 1.678 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 38 | 29 | 28 | 33 | 31 | 38 | 24 | 29 |
| N.S. | 1 | 1.00 | 1.00 | 0.76 | 0.74 | 0.87 | 0.82 | 1.00 | 0.63 | 0.76 |
| time (sec) |
N/A | 0.008 | 0.002 | 0.092 | 0.242 | 0.315 | 0.067 | 0.000 | 0.088 | 1.743 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 45 | 34 | 33 | 38 | 36 | 43 | 28 | 34 |
| N.S. | 1 | 1.00 | 1.00 | 0.76 | 0.73 | 0.84 | 0.80 | 0.96 | 0.62 | 0.76 |
| time (sec) |
N/A | 0.009 | 0.002 | 0.096 | 0.282 | 0.314 | 0.069 | 0.000 | 0.040 | 1.760 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 26 | 23 | 22 | 32 | 19 | 29 | 20 | 26 |
| N.S. | 1 | 1.00 | 0.93 | 0.82 | 0.79 | 1.14 | 0.68 | 1.04 | 0.71 | 0.93 |
| time (sec) |
N/A | 0.007 | 0.009 | 0.089 | 0.238 | 0.311 | 0.059 | 0.000 | 0.055 | 1.666 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 31 | 28 | 31 | 48 | 31 | 38 | 34 | 34 |
| N.S. | 1 | 1.00 | 0.89 | 0.80 | 0.89 | 1.37 | 0.89 | 1.09 | 0.97 | 0.97 |
| time (sec) |
N/A | 0.008 | 0.009 | 0.098 | 0.244 | 0.542 | 0.066 | 0.000 | 0.089 | 1.786 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 42 | 42 | 36 | 33 | 38 | 59 | 36 | 43 | 31 | 41 |
| N.S. | 1 | 1.00 | 0.86 | 0.79 | 0.90 | 1.40 | 0.86 | 1.02 | 0.74 | 0.98 |
| time (sec) |
N/A | 0.010 | 0.008 | 0.099 | 0.248 | 0.310 | 0.072 | 0.000 | 0.042 | 1.829 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 44 | 38 | 43 | 64 | 41 | 50 | 37 | 46 |
| N.S. | 1 | 1.00 | 0.90 | 0.78 | 0.88 | 1.31 | 0.84 | 1.02 | 0.76 | 0.94 |
| time (sec) |
N/A | 0.011 | 0.018 | 0.104 | 0.252 | 0.312 | 0.074 | 0.000 | 0.093 | 1.873 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 56 | 56 | 56 | 43 | 48 | 69 | 46 | 54 | 41 | 51 |
| N.S. | 1 | 1.00 | 1.00 | 0.77 | 0.86 | 1.23 | 0.82 | 0.96 | 0.73 | 0.91 |
| time (sec) |
N/A | 0.014 | 0.006 | 0.111 | 0.240 | 0.310 | 0.077 | 0.000 | 0.095 | 1.905 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 39 | 39 | 29 | 32 | 30 | 50 | 27 | 35 | 29 | 39 |
| N.S. | 1 | 1.00 | 0.74 | 0.82 | 0.77 | 1.28 | 0.69 | 0.90 | 0.74 | 1.00 |
| time (sec) |
N/A | 0.009 | 0.013 | 0.104 | 0.244 | 0.310 | 0.071 | 0.000 | 0.125 | 1.779 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 46 | 46 | 39 | 37 | 41 | 68 | 41 | 45 | 35 | 49 |
| N.S. | 1 | 1.00 | 0.85 | 0.80 | 0.89 | 1.48 | 0.89 | 0.98 | 0.76 | 1.07 |
| time (sec) |
N/A | 0.011 | 0.013 | 0.122 | 0.255 | 0.310 | 0.078 | 0.000 | 0.092 | 1.861 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 44 | 42 | 48 | 79 | 46 | 53 | 41 | 56 |
| N.S. | 1 | 1.00 | 0.83 | 0.79 | 0.91 | 1.49 | 0.87 | 1.00 | 0.77 | 1.06 |
| time (sec) |
N/A | 0.012 | 0.015 | 0.102 | 0.252 | 0.314 | 0.079 | 0.000 | 0.094 | 1.912 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 60 | 60 | 49 | 47 | 53 | 84 | 51 | 58 | 47 | 61 |
| N.S. | 1 | 1.00 | 0.82 | 0.78 | 0.88 | 1.40 | 0.85 | 0.97 | 0.78 | 1.02 |
| time (sec) |
N/A | 0.015 | 0.011 | 0.103 | 0.237 | 0.313 | 0.086 | 0.000 | 0.046 | 1.948 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 54 | 52 | 58 | 89 | 56 | 61 | 51 | 66 |
| N.S. | 1 | 1.00 | 0.81 | 0.78 | 0.87 | 1.33 | 0.84 | 0.91 | 0.76 | 0.99 |
| time (sec) |
N/A | 0.016 | 0.012 | 0.104 | 0.243 | 0.318 | 0.087 | 0.001 | 0.047 | 2.038 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 8 | 8 | 10 | 9 | 6 | 6 | 7 | 8 | 6 | 8 |
| N.S. | 1 | 1.00 | 1.25 | 1.12 | 0.75 | 0.75 | 0.88 | 1.00 | 0.75 | 1.00 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.082 | 0.245 | 0.299 | 0.027 | 0.000 | 0.151 | 1.547 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 10 | 10 | 10 | 9 | 8 | 8 | 8 | 11 | 6 | 8 |
| N.S. | 1 | 1.00 | 1.00 | 0.90 | 0.80 | 0.80 | 0.80 | 1.10 | 0.60 | 0.80 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.083 | 0.279 | 0.311 | 0.029 | 0.000 | 0.077 | 1.566 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 16 | 13 | 12 | 10 | 14 | 18 | 10 | 12 |
| N.S. | 1 | 1.00 | 1.14 | 0.93 | 0.86 | 0.71 | 1.00 | 1.29 | 0.71 | 0.86 |
| time (sec) |
N/A | 0.002 | 0.003 | 0.091 | 0.267 | 0.315 | 0.032 | 0.001 | 0.105 | 1.595 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 20 | 17 | 16 | 20 | 17 | 21 | 16 | 16 |
| N.S. | 1 | 1.00 | 1.00 | 0.85 | 0.80 | 1.00 | 0.85 | 1.05 | 0.80 | 0.80 |
| time (sec) |
N/A | 0.007 | 0.003 | 0.089 | 0.299 | 0.299 | 0.035 | 0.000 | 0.108 | 1.641 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 22 | 19 | 18 | 21 | 19 | 23 | 14 | 18 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.82 | 0.95 | 0.86 | 1.05 | 0.64 | 0.82 |
| time (sec) |
N/A | 0.002 | 0.002 | 0.087 | 0.240 | 0.320 | 0.033 | 0.000 | 0.052 | 1.647 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 22 | 19 | 18 | 23 | 19 | 25 | 16 | 18 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.82 | 1.05 | 0.86 | 1.14 | 0.73 | 0.82 |
| time (sec) |
N/A | 0.002 | 0.002 | 0.091 | 0.278 | 0.315 | 0.033 | 0.000 | 0.057 | 1.665 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 21 | 19 | 18 | 24 | 19 | 28 | 16 | 17 |
| N.S. | 1 | 1.00 | 1.00 | 0.90 | 0.86 | 1.14 | 0.90 | 1.33 | 0.76 | 0.81 |
| time (sec) |
N/A | 0.003 | 0.004 | 0.090 | 0.277 | 0.308 | 0.037 | 0.000 | 0.152 | 1.675 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 22 | 19 | 18 | 24 | 20 | 30 | 14 | 16 |
| N.S. | 1 | 1.00 | 1.10 | 0.95 | 0.90 | 1.20 | 1.00 | 1.50 | 0.70 | 0.80 |
| time (sec) |
N/A | 0.003 | 0.006 | 0.088 | 0.240 | 0.321 | 0.039 | 0.000 | 0.175 | 1.631 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 11 | 11 | 11 | 12 | 11 | 11 | 8 | 12 | 9 | 11 |
| N.S. | 1 | 1.00 | 1.00 | 1.09 | 1.00 | 1.00 | 0.73 | 1.09 | 0.82 | 1.00 |
| time (sec) |
N/A | 0.002 | 0.002 | 0.094 | 0.239 | 0.306 | 0.057 | 0.000 | 0.097 | 1.577 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 12 | 12 | 12 | 12 | 11 | 11 | 8 | 12 | 9 | 13 |
| N.S. | 1 | 1.00 | 1.00 | 1.00 | 0.92 | 0.92 | 0.67 | 1.00 | 0.75 | 1.08 |
| time (sec) |
N/A | 0.002 | 0.002 | 0.088 | 0.257 | 0.299 | 0.058 | 0.000 | 0.036 | 1.571 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 19 | 20 | 19 | 21 | 14 | 23 | 16 | 19 |
| N.S. | 1 | 1.00 | 1.00 | 1.05 | 1.00 | 1.11 | 0.74 | 1.21 | 0.84 | 1.00 |
| time (sec) |
N/A | 0.006 | 0.003 | 0.111 | 0.254 | 0.308 | 0.073 | 0.001 | 0.043 | 1.694 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 18 | 18 | 18 | 18 | 17 | 21 | 14 | 22 | 14 | 19 |
| N.S. | 1 | 1.00 | 1.00 | 1.00 | 0.94 | 1.17 | 0.78 | 1.22 | 0.78 | 1.06 |
| time (sec) |
N/A | 0.007 | 0.002 | 0.110 | 0.270 | 0.577 | 0.080 | 0.000 | 0.029 | 1.701 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 15 | 14 | 15 | 10 | 28 | 20 | 14 |
| N.S. | 1 | 1.00 | 1.00 | 1.07 | 1.00 | 1.07 | 0.71 | 2.00 | 1.43 | 1.00 |
| time (sec) |
N/A | 0.007 | 0.003 | 0.086 | 0.244 | 0.309 | 0.071 | 0.000 | 0.036 | 1.603 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 46 | 50 | 56 | 53 | 1742 | 192 | 56 | 316 |
| N.S. | 1 | 1.00 | 0.64 | 0.69 | 0.78 | 0.74 | 24.19 | 2.67 | 0.78 | 4.39 |
| time (sec) |
N/A | 0.014 | 0.046 | 0.102 | 0.287 | 0.314 | 1.265 | 0.001 | 0.050 | 16.096 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 35 | 38 | 41 | 42 | 666 | 145 | 37 | 184 |
| N.S. | 1 | 1.00 | 0.66 | 0.72 | 0.77 | 0.79 | 12.57 | 2.74 | 0.70 | 3.47 |
| time (sec) |
N/A | 0.010 | 0.017 | 0.095 | 0.274 | 0.309 | 0.880 | 0.001 | 0.046 | 7.266 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 34 | 26 | 26 | 30 | 202 | 99 | 25 | 96 |
| N.S. | 1 | 1.00 | 1.00 | 0.76 | 0.76 | 0.88 | 5.94 | 2.91 | 0.74 | 2.82 |
| time (sec) |
N/A | 0.006 | 0.014 | 0.080 | 0.292 | 0.305 | 0.580 | 0.001 | 0.028 | 3.456 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 12 | 12 | 21 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 0.75 | 0.75 | 1.31 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.001 | 0.006 | 0.081 | 0.279 | 0.294 | 0.029 | 0.000 | 0.021 | 1.585 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 35 | 28 | 42 | 73 | 68 | 42 | 27 | 74 |
| N.S. | 1 | 1.00 | 1.00 | 0.80 | 1.20 | 2.09 | 1.94 | 1.20 | 0.77 | 2.11 |
| time (sec) |
N/A | 0.013 | 0.022 | 0.081 | 0.358 | 0.576 | 0.709 | 0.002 | 0.094 | 2.679 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 39 | 39 | 39 | 37 | 47 | 93 | 44 | 58 | 31 | 38 |
| N.S. | 1 | 1.00 | 1.00 | 0.95 | 1.21 | 2.38 | 1.13 | 1.49 | 0.79 | 0.97 |
| time (sec) |
N/A | 0.008 | 0.045 | 0.085 | 0.405 | 0.310 | 0.929 | 0.002 | 0.053 | 2.692 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 55 | 54 | 88 | 119 | 97 | 89 | 48 | 100 |
| N.S. | 1 | 1.00 | 0.85 | 0.83 | 1.35 | 1.83 | 1.49 | 1.37 | 0.74 | 1.54 |
| time (sec) |
N/A | 0.013 | 0.073 | 0.095 | 0.347 | 0.329 | 2.110 | 0.002 | 0.068 | 4.094 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 87 | 87 | 67 | 66 | 121 | 145 | 122 | 119 | 66 | 135 |
| N.S. | 1 | 1.00 | 0.77 | 0.76 | 1.39 | 1.67 | 1.40 | 1.37 | 0.76 | 1.55 |
| time (sec) |
N/A | 0.018 | 0.099 | 0.092 | 0.382 | 0.316 | 5.282 | 0.002 | 0.107 | 7.082 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 46 | 50 | 56 | 64 | 1742 | 326 | 56 | 316 |
| N.S. | 1 | 1.00 | 0.64 | 0.69 | 0.78 | 0.89 | 24.19 | 4.53 | 0.78 | 4.39 |
| time (sec) |
N/A | 0.013 | 0.022 | 0.085 | 0.248 | 0.709 | 1.368 | 0.002 | 0.048 | 16.413 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 35 | 38 | 41 | 53 | 733 | 257 | 37 | 197 |
| N.S. | 1 | 1.00 | 0.66 | 0.72 | 0.77 | 1.00 | 13.83 | 4.85 | 0.70 | 3.72 |
| time (sec) |
N/A | 0.009 | 0.019 | 0.084 | 0.294 | 0.311 | 0.956 | 0.002 | 0.041 | 7.722 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 24 | 26 | 26 | 41 | 80 | 185 | 25 | 53 |
| N.S. | 1 | 1.00 | 0.71 | 0.76 | 0.76 | 1.21 | 2.35 | 5.44 | 0.74 | 1.56 |
| time (sec) |
N/A | 0.006 | 0.017 | 0.090 | 0.279 | 0.301 | 0.154 | 0.001 | 0.026 | 1.995 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 28 | 12 | 113 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 1.75 | 0.75 | 7.06 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.001 | 0.007 | 0.099 | 0.266 | 0.298 | 0.029 | 0.001 | 0.016 | 1.572 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 44 | 38 | 52 | 88 | 71 | 63 | 37 | 62 |
| N.S. | 1 | 1.00 | 0.90 | 0.78 | 1.06 | 1.80 | 1.45 | 1.29 | 0.76 | 1.27 |
| time (sec) |
N/A | 0.012 | 0.023 | 0.101 | 0.380 | 0.309 | 1.126 | 0.002 | 0.042 | 3.079 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 45 | 48 | 58 | 102 | 92 | 74 | 42 | 82 |
| N.S. | 1 | 1.00 | 0.88 | 0.94 | 1.14 | 2.00 | 1.80 | 1.45 | 0.82 | 1.61 |
| time (sec) |
N/A | 0.011 | 0.052 | 0.104 | 0.359 | 0.304 | 1.344 | 0.003 | 0.100 | 3.413 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 62 | 62 | 53 | 52 | 86 | 124 | 76 | 86 | 46 | 61 |
| N.S. | 1 | 1.00 | 0.85 | 0.84 | 1.39 | 2.00 | 1.23 | 1.39 | 0.74 | 0.98 |
| time (sec) |
N/A | 0.012 | 0.089 | 0.095 | 0.354 | 0.611 | 1.597 | 0.003 | 0.057 | 3.490 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 67 | 64 | 119 | 145 | 124 | 116 | 64 | 135 |
| N.S. | 1 | 1.00 | 0.80 | 0.76 | 1.42 | 1.73 | 1.48 | 1.38 | 0.76 | 1.61 |
| time (sec) |
N/A | 0.016 | 0.104 | 0.095 | 0.373 | 0.318 | 3.699 | 0.003 | 0.102 | 5.744 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 46 | 50 | 56 | 75 | 146 | 481 | 56 | 88 |
| N.S. | 1 | 1.00 | 0.64 | 0.69 | 0.78 | 1.04 | 2.03 | 6.68 | 0.78 | 1.22 |
| time (sec) |
N/A | 0.012 | 0.025 | 0.086 | 0.254 | 0.294 | 0.410 | 0.003 | 0.050 | 2.630 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 35 | 38 | 41 | 64 | 124 | 391 | 37 | 76 |
| N.S. | 1 | 1.00 | 0.66 | 0.72 | 0.77 | 1.21 | 2.34 | 7.38 | 0.70 | 1.43 |
| time (sec) |
N/A | 0.009 | 0.022 | 0.090 | 0.257 | 0.310 | 0.347 | 0.002 | 0.044 | 2.385 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 24 | 26 | 26 | 52 | 102 | 297 | 25 | 64 |
| N.S. | 1 | 1.00 | 0.71 | 0.76 | 0.76 | 1.53 | 3.00 | 8.74 | 0.74 | 1.88 |
| time (sec) |
N/A | 0.006 | 0.018 | 0.102 | 0.255 | 0.303 | 0.276 | 0.002 | 0.028 | 2.176 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 39 | 12 | 199 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 2.44 | 0.75 | 12.44 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.001 | 0.007 | 0.098 | 0.270 | 0.297 | 0.032 | 0.001 | 0.018 | 1.583 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 56 | 50 | 64 | 114 | 97 | 86 | 52 | 88 |
| N.S. | 1 | 1.00 | 0.86 | 0.77 | 0.98 | 1.75 | 1.49 | 1.32 | 0.80 | 1.35 |
| time (sec) |
N/A | 0.014 | 0.043 | 0.086 | 0.360 | 0.308 | 2.366 | 0.003 | 0.053 | 4.297 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 60 | 62 | 71 | 126 | 99 | 100 | 58 | 85 |
| N.S. | 1 | 1.00 | 0.91 | 0.94 | 1.08 | 1.91 | 1.50 | 1.52 | 0.88 | 1.29 |
| time (sec) |
N/A | 0.015 | 0.068 | 0.099 | 0.347 | 0.599 | 2.234 | 0.004 | 0.115 | 4.187 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 78 | 78 | 63 | 62 | 101 | 133 | 126 | 104 | 64 | 135 |
| N.S. | 1 | 1.00 | 0.81 | 0.79 | 1.29 | 1.71 | 1.62 | 1.33 | 0.82 | 1.73 |
| time (sec) |
N/A | 0.015 | 0.090 | 0.095 | 0.347 | 0.307 | 2.523 | 0.004 | 0.053 | 4.573 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 64 | 64 | 115 | 146 | 104 | 110 | 64 | 84 |
| N.S. | 1 | 1.00 | 0.79 | 0.79 | 1.42 | 1.80 | 1.28 | 1.36 | 0.79 | 1.04 |
| time (sec) |
N/A | 0.015 | 0.119 | 0.095 | 0.343 | 0.317 | 2.807 | 0.004 | 0.046 | 4.637 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 103 | 103 | 78 | 76 | 144 | 167 | 155 | 142 | 79 | 145 |
| N.S. | 1 | 1.00 | 0.76 | 0.74 | 1.40 | 1.62 | 1.50 | 1.38 | 0.77 | 1.41 |
| time (sec) |
N/A | 0.022 | 0.133 | 0.102 | 0.364 | 0.588 | 7.653 | 0.005 | 0.111 | 9.712 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 146 | 146 | 90 | 97 | 116 | 141 | 279 | 1417 | 116 | 154 |
| N.S. | 1 | 1.00 | 0.62 | 0.66 | 0.79 | 0.97 | 1.91 | 9.71 | 0.79 | 1.05 |
| time (sec) |
N/A | 0.029 | 0.042 | 0.087 | 0.252 | 0.304 | 1.673 | 0.006 | 0.036 | 4.274 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 127 | 127 | 79 | 85 | 101 | 130 | 257 | 1278 | 101 | 143 |
| N.S. | 1 | 1.00 | 0.62 | 0.67 | 0.80 | 1.02 | 2.02 | 10.06 | 0.80 | 1.13 |
| time (sec) |
N/A | 0.026 | 0.037 | 0.085 | 0.269 | 0.312 | 1.496 | 0.006 | 0.031 | 4.050 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 110 | 110 | 68 | 74 | 86 | 119 | 235 | 1141 | 86 | 132 |
| N.S. | 1 | 1.00 | 0.62 | 0.67 | 0.78 | 1.08 | 2.14 | 10.37 | 0.78 | 1.20 |
| time (sec) |
N/A | 0.021 | 0.030 | 0.089 | 0.265 | 0.306 | 1.339 | 0.005 | 0.027 | 3.782 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 91 | 91 | 57 | 62 | 71 | 108 | 212 | 1004 | 71 | 120 |
| N.S. | 1 | 1.00 | 0.63 | 0.68 | 0.78 | 1.19 | 2.33 | 11.03 | 0.78 | 1.32 |
| time (sec) |
N/A | 0.018 | 0.028 | 0.087 | 0.264 | 0.315 | 1.202 | 0.005 | 0.025 | 3.553 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 46 | 50 | 56 | 97 | 190 | 866 | 56 | 109 |
| N.S. | 1 | 1.00 | 0.64 | 0.69 | 0.78 | 1.35 | 2.64 | 12.03 | 0.78 | 1.51 |
| time (sec) |
N/A | 0.013 | 0.026 | 0.089 | 0.258 | 0.313 | 1.066 | 0.005 | 0.045 | 3.332 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 35 | 38 | 41 | 86 | 168 | 727 | 36 | 98 |
| N.S. | 1 | 1.00 | 0.66 | 0.72 | 0.77 | 1.62 | 3.17 | 13.72 | 0.68 | 1.85 |
| time (sec) |
N/A | 0.010 | 0.023 | 0.098 | 0.263 | 0.302 | 0.948 | 0.004 | 0.040 | 3.138 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 24 | 26 | 26 | 74 | 146 | 586 | 25 | 86 |
| N.S. | 1 | 1.00 | 0.71 | 0.76 | 0.76 | 2.18 | 4.29 | 17.24 | 0.74 | 2.53 |
| time (sec) |
N/A | 0.006 | 0.019 | 0.102 | 0.272 | 0.300 | 0.816 | 0.003 | 0.030 | 2.944 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 61 | 12 | 445 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 3.81 | 0.75 | 27.81 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.001 | 0.008 | 0.095 | 0.253 | 0.297 | 0.039 | 0.003 | 0.018 | 1.600 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 97 | 97 | 78 | 74 | 88 | 158 | 148 | 132 | 76 | 132 |
| N.S. | 1 | 1.00 | 0.80 | 0.76 | 0.91 | 1.63 | 1.53 | 1.36 | 0.78 | 1.36 |
| time (sec) |
N/A | 0.024 | 0.040 | 0.089 | 0.344 | 0.319 | 11.286 | 0.004 | 0.037 | 12.626 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 98 | 98 | 82 | 85 | 97 | 172 | 150 | 150 | 84 | 133 |
| N.S. | 1 | 1.00 | 0.84 | 0.87 | 0.99 | 1.76 | 1.53 | 1.53 | 0.86 | 1.36 |
| time (sec) |
N/A | 0.026 | 0.075 | 0.097 | 0.362 | 0.329 | 10.913 | 0.005 | 0.043 | 12.331 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 114 | 114 | 86 | 87 | 131 | 180 | 184 | 154 | 117 | 155 |
| N.S. | 1 | 1.00 | 0.75 | 0.76 | 1.15 | 1.58 | 1.61 | 1.35 | 1.03 | 1.36 |
| time (sec) |
N/A | 0.026 | 0.102 | 0.105 | 0.360 | 0.332 | 10.440 | 0.005 | 0.047 | 12.060 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 114 | 114 | 85 | 89 | 145 | 178 | 184 | 154 | 131 | 148 |
| N.S. | 1 | 1.00 | 0.75 | 0.78 | 1.27 | 1.56 | 1.61 | 1.35 | 1.15 | 1.30 |
| time (sec) |
N/A | 0.026 | 0.122 | 0.100 | 0.344 | 0.311 | 9.889 | 0.006 | 0.121 | 11.717 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 116 | 116 | 86 | 86 | 155 | 177 | 182 | 152 | 94 | 185 |
| N.S. | 1 | 1.00 | 0.74 | 0.74 | 1.34 | 1.53 | 1.57 | 1.31 | 0.81 | 1.59 |
| time (sec) |
N/A | 0.026 | 0.141 | 0.102 | 0.343 | 0.312 | 10.358 | 0.007 | 0.062 | 11.988 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 119 | 119 | 86 | 88 | 169 | 190 | 158 | 159 | 94 | 130 |
| N.S. | 1 | 1.00 | 0.72 | 0.74 | 1.42 | 1.60 | 1.33 | 1.34 | 0.79 | 1.09 |
| time (sec) |
N/A | 0.027 | 0.174 | 0.125 | 0.349 | 0.328 | 11.040 | 0.006 | 0.119 | 12.499 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 141 | 141 | 100 | 100 | 198 | 211 | 209 | 190 | 109 | 181 |
| N.S. | 1 | 1.00 | 0.71 | 0.71 | 1.40 | 1.50 | 1.48 | 1.35 | 0.77 | 1.28 |
| time (sec) |
N/A | 0.036 | 0.190 | 0.115 | 0.368 | 0.314 | 47.697 | 0.007 | 0.133 | 47.084 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-1) | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 163 | 163 | 111 | 112 | 229 | 233 | 0 | 218 | 124 | 243 |
| N.S. |
1 | 1.00 | 0.68 | 0.69 | 1.40 | 1.43 | 0.00 | 1.34 | 0.76 | 1.49 |
| time (sec) |
N/A | 0.047 | 0.212 | 0.107 | 0.353 | 0.319 | 0.000 | 0.007 | 0.126 | 275.322 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 39 | 39 | 39 | 32 | 31 | 78 | 148 | 43 | 31 | 153 |
| N.S. | 1 | 1.00 | 1.00 | 0.82 | 0.79 | 2.00 | 3.79 | 1.10 | 0.79 | 3.92 |
| time (sec) |
N/A | 0.007 | 0.020 | 0.089 | 0.355 | 0.315 | 0.755 | 0.001 | 0.094 | 2.957 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 42 | 42 | 42 | 41 | 34 | 98 | 117 | 58 | 34 | 112 |
| N.S. | 1 | 1.00 | 1.00 | 0.98 | 0.81 | 2.33 | 2.79 | 1.38 | 0.81 | 2.67 |
| time (sec) |
N/A | 0.007 | 0.036 | 0.098 | 0.345 | 0.321 | 0.950 | 0.002 | 0.097 | 2.894 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 71 | 71 | 60 | 59 | 83 | 124 | 207 | 90 | 54 | 206 |
| N.S. | 1 | 1.00 | 0.85 | 0.83 | 1.17 | 1.75 | 2.92 | 1.27 | 0.76 | 2.90 |
| time (sec) |
N/A | 0.012 | 0.077 | 0.112 | 0.346 | 0.316 | 2.051 | 0.002 | 0.103 | 24.368 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 55 | 55 | 48 | 44 | 43 | 93 | 187 | 66 | 43 | 155 |
| N.S. | 1 | 1.00 | 0.87 | 0.80 | 0.78 | 1.69 | 3.40 | 1.20 | 0.78 | 2.82 |
| time (sec) |
N/A | 0.011 | 0.032 | 0.100 | 0.348 | 0.330 | 1.206 | 0.002 | 0.041 | 3.359 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 48 | 54 | 47 | 105 | 197 | 75 | 47 | 194 |
| N.S. | 1 | 1.00 | 0.84 | 0.95 | 0.82 | 1.84 | 3.46 | 1.32 | 0.82 | 3.40 |
| time (sec) |
N/A | 0.011 | 0.049 | 0.105 | 0.342 | 0.311 | 1.363 | 0.003 | 0.045 | 3.788 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 56 | 57 | 80 | 129 | 189 | 88 | 52 | 162 |
| N.S. | 1 | 1.00 | 0.82 | 0.84 | 1.18 | 1.90 | 2.78 | 1.29 | 0.76 | 2.38 |
| time (sec) |
N/A | 0.011 | 0.081 | 0.110 | 0.356 | 0.317 | 1.573 | 0.003 | 0.097 | 3.620 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 73 | 73 | 60 | 58 | 57 | 119 | 240 | 92 | 57 | 207 |
| N.S. | 1 | 1.00 | 0.82 | 0.79 | 0.78 | 1.63 | 3.29 | 1.26 | 0.78 | 2.84 |
| time (sec) |
N/A | 0.015 | 0.046 | 0.092 | 0.354 | 0.308 | 2.393 | 0.002 | 0.043 | 4.642 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 64 | 69 | 63 | 131 | 245 | 104 | 63 | 204 |
| N.S. | 1 | 1.00 | 0.86 | 0.93 | 0.85 | 1.77 | 3.31 | 1.41 | 0.85 | 2.76 |
| time (sec) |
N/A | 0.015 | 0.060 | 0.107 | 0.355 | 0.309 | 2.303 | 0.004 | 0.103 | 4.504 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 86 | 86 | 67 | 70 | 97 | 139 | 267 | 106 | 69 | 266 |
| N.S. | 1 | 1.00 | 0.78 | 0.81 | 1.13 | 1.62 | 3.10 | 1.23 | 0.80 | 3.09 |
| time (sec) |
N/A | 0.016 | 0.085 | 0.098 | 0.345 | 0.314 | 2.408 | 0.007 | 0.095 | 11.808 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 89 | 89 | 57 | 61 | 71 | 53 | 3755 | 108 | 71 | 494 |
| N.S. | 1 | 1.00 | 0.64 | 0.69 | 0.80 | 0.60 | 42.19 | 1.21 | 0.80 | 5.55 |
| time (sec) |
N/A | 0.015 | 0.022 | 0.086 | 0.268 | 0.303 | 2.206 | 0.001 | 0.024 | 33.831 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 46 | 49 | 56 | 42 | 1640 | 82 | 56 | 308 |
| N.S. | 1 | 1.00 | 0.68 | 0.72 | 0.82 | 0.62 | 24.12 | 1.21 | 0.82 | 4.53 |
| time (sec) |
N/A | 0.012 | 0.021 | 0.092 | 0.257 | 0.312 | 1.281 | 0.001 | 0.046 | 15.242 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 35 | 37 | 41 | 31 | 600 | 61 | 37 | 160 |
| N.S. | 1 | 1.00 | 0.69 | 0.73 | 0.80 | 0.61 | 11.76 | 1.20 | 0.73 | 3.14 |
| time (sec) |
N/A | 0.009 | 0.018 | 0.088 | 0.282 | 0.298 | 0.851 | 0.001 | 0.038 | 7.001 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 23 | 26 | 26 | 19 | 162 | 36 | 25 | 73 |
| N.S. | 1 | 1.00 | 0.72 | 0.81 | 0.81 | 0.59 | 5.06 | 1.12 | 0.78 | 2.28 |
| time (sec) |
N/A | 0.006 | 0.013 | 0.084 | 0.262 | 0.306 | 0.559 | 0.001 | 0.027 | 3.305 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 12 | 10 | 13 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 0.86 | 0.71 | 0.93 | 0.86 | 0.86 |
| time (sec) |
N/A | 0.001 | 0.005 | 0.090 | 0.261 | 0.296 | 0.030 | 0.000 | 0.018 | 1.609 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 23 | 18 | 32 | 56 | 24 | 27 | 17 | 16 |
| N.S. | 1 | 1.00 | 1.00 | 0.78 | 1.39 | 2.43 | 1.04 | 1.17 | 0.74 | 0.70 |
| time (sec) |
N/A | 0.005 | 0.014 | 0.082 | 0.361 | 0.324 | 0.491 | 0.001 | 0.055 | 2.058 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 41 | 40 | 60 | 93 | 44 | 65 | 33 | 40 |
| N.S. | 1 | 1.00 | 1.00 | 0.98 | 1.46 | 2.27 | 1.07 | 1.59 | 0.80 | 0.98 |
| time (sec) |
N/A | 0.008 | 0.044 | 0.111 | 0.345 | 0.330 | 1.170 | 0.001 | 0.111 | 3.010 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 56 | 66 | 92 | 123 | 102 | 97 | 51 | 102 |
| N.S. | 1 | 1.00 | 0.82 | 0.97 | 1.35 | 1.81 | 1.50 | 1.43 | 0.75 | 1.50 |
| time (sec) |
N/A | 0.011 | 0.068 | 0.113 | 0.360 | 0.310 | 2.699 | 0.002 | 0.061 | 4.732 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 90 | 90 | 67 | 90 | 121 | 145 | 129 | 122 | 69 | 137 |
| N.S. | 1 | 1.00 | 0.74 | 1.00 | 1.34 | 1.61 | 1.43 | 1.36 | 0.77 | 1.52 |
| time (sec) |
N/A | 0.018 | 0.072 | 0.095 | 0.360 | 0.522 | 7.925 | 0.001 | 0.052 | 9.905 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 85 | 85 | 57 | 62 | 71 | 63 | 3606 | 115 | 71 | 484 |
| N.S. | 1 | 1.00 | 0.67 | 0.73 | 0.84 | 0.74 | 42.42 | 1.35 | 0.84 | 5.69 |
| time (sec) |
N/A | 0.016 | 0.024 | 0.094 | 0.259 | 0.296 | 2.196 | 0.002 | 0.028 | 32.007 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 45 | 49 | 56 | 51 | 1538 | 86 | 56 | 280 |
| N.S. | 1 | 1.00 | 0.68 | 0.74 | 0.85 | 0.77 | 23.30 | 1.30 | 0.85 | 4.24 |
| time (sec) |
N/A | 0.013 | 0.020 | 0.112 | 0.257 | 0.297 | 1.342 | 0.003 | 0.048 | 14.563 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 34 | 38 | 41 | 40 | 534 | 64 | 35 | 145 |
| N.S. | 1 | 1.00 | 0.69 | 0.78 | 0.84 | 0.82 | 10.90 | 1.31 | 0.71 | 2.96 |
| time (sec) |
N/A | 0.009 | 0.021 | 0.111 | 0.300 | 0.298 | 0.837 | 0.001 | 0.040 | 6.263 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 21 | 23 | 26 | 29 | 37 | 31 | 19 | 33 |
| N.S. | 1 | 1.00 | 0.70 | 0.77 | 0.87 | 0.97 | 1.23 | 1.03 | 0.63 | 1.10 |
| time (sec) |
N/A | 0.006 | 0.012 | 0.114 | 0.256 | 0.313 | 0.292 | 0.001 | 0.087 | 1.909 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 20 | 12 | 15 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 1.43 | 0.86 | 1.07 | 0.86 | 0.86 |
| time (sec) |
N/A | 0.001 | 0.008 | 0.115 | 0.261 | 0.304 | 0.030 | 0.001 | 0.019 | 1.626 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 38 | 31 | 45 | 110 | 146 | 47 | 30 | 78 |
| N.S. | 1 | 1.00 | 1.00 | 0.82 | 1.18 | 2.89 | 3.84 | 1.24 | 0.79 | 2.05 |
| time (sec) |
N/A | 0.008 | 0.028 | 0.132 | 0.340 | 0.315 | 0.849 | 0.001 | 0.043 | 3.548 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 49 | 54 | 76 | 151 | 73 | 89 | 60 | 88 |
| N.S. | 1 | 1.00 | 0.86 | 0.95 | 1.33 | 2.65 | 1.28 | 1.56 | 1.05 | 1.54 |
| time (sec) |
N/A | 0.012 | 0.060 | 0.103 | 0.368 | 0.318 | 1.847 | 0.002 | 0.122 | 3.709 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 87 | 87 | 67 | 68 | 108 | 189 | 107 | 113 | 90 | 103 |
| N.S. | 1 | 1.00 | 0.77 | 0.78 | 1.24 | 2.17 | 1.23 | 1.30 | 1.03 | 1.18 |
| time (sec) |
N/A | 0.016 | 0.090 | 0.120 | 0.347 | 0.313 | 4.074 | 0.002 | 0.059 | 5.993 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 87 | 87 | 57 | 62 | 71 | 74 | 3456 | 109 | 68 | 454 |
| N.S. | 1 | 1.00 | 0.66 | 0.71 | 0.82 | 0.85 | 39.72 | 1.25 | 0.78 | 5.22 |
| time (sec) |
N/A | 0.016 | 0.027 | 0.115 | 0.280 | 0.307 | 2.148 | 0.003 | 0.049 | 30.780 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 47 | 50 | 56 | 62 | 163 | 83 | 47 | 55 |
| N.S. | 1 | 1.00 | 0.69 | 0.74 | 0.82 | 0.91 | 2.40 | 1.22 | 0.69 | 0.81 |
| time (sec) |
N/A | 0.013 | 0.024 | 0.098 | 0.285 | 0.313 | 0.412 | 0.002 | 0.043 | 3.186 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 35 | 36 | 41 | 52 | 121 | 53 | 35 | 45 |
| N.S. | 1 | 1.00 | 0.71 | 0.73 | 0.84 | 1.06 | 2.47 | 1.08 | 0.71 | 0.92 |
| time (sec) |
N/A | 0.009 | 0.022 | 0.101 | 0.261 | 0.308 | 0.411 | 0.002 | 0.084 | 2.900 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 24 | 26 | 26 | 41 | 80 | 34 | 20 | 34 |
| N.S. | 1 | 1.00 | 0.75 | 0.81 | 0.81 | 1.28 | 2.50 | 1.06 | 0.62 | 1.06 |
| time (sec) |
N/A | 0.006 | 0.014 | 0.093 | 0.247 | 0.303 | 0.395 | 0.002 | 0.033 | 2.464 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 31 | 14 | 23 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 1.94 | 0.88 | 1.44 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.001 | 0.007 | 0.092 | 0.253 | 0.305 | 0.040 | 0.001 | 0.018 | 1.614 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 54 | 54 | 49 | 43 | 53 | 177 | 697 | 65 | 42 | 205 |
| N.S. | 1 | 1.00 | 0.91 | 0.80 | 0.98 | 3.28 | 12.91 | 1.20 | 0.78 | 3.80 |
| time (sec) |
N/A | 0.012 | 0.049 | 0.120 | 0.345 | 0.315 | 1.435 | 0.002 | 0.050 | 8.010 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 63 | 66 | 89 | 221 | 818 | 100 | 73 | 231 |
| N.S. | 1 | 1.00 | 0.85 | 0.89 | 1.20 | 2.99 | 11.05 | 1.35 | 0.99 | 3.12 |
| time (sec) |
N/A | 0.016 | 0.075 | 0.105 | 0.355 | 0.317 | 2.862 | 0.002 | 0.109 | 10.337 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 106 | 106 | 78 | 81 | 123 | 255 | 464 | 134 | 105 | 172 |
| N.S. | 1 | 1.00 | 0.74 | 0.76 | 1.16 | 2.41 | 4.38 | 1.26 | 0.99 | 1.62 |
| time (sec) |
N/A | 0.023 | 0.107 | 0.106 | 0.351 | 0.322 | 10.531 | 0.002 | 0.120 | 12.235 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 25 | 25 | 25 | 20 | 19 | 58 | 54 | 26 | 19 | 46 |
| N.S. | 1 | 1.00 | 1.00 | 0.80 | 0.76 | 2.32 | 2.16 | 1.04 | 0.76 | 1.84 |
| time (sec) |
N/A | 0.006 | 0.015 | 0.095 | 0.339 | 0.320 | 0.509 | 0.001 | 0.048 | 2.390 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 44 | 44 | 44 | 44 | 46 | 97 | 121 | 63 | 36 | 117 |
| N.S. | 1 | 1.00 | 1.00 | 1.00 | 1.05 | 2.20 | 2.75 | 1.43 | 0.82 | 2.66 |
| time (sec) |
N/A | 0.008 | 0.035 | 0.131 | 0.336 | 0.331 | 1.180 | 0.001 | 0.041 | 3.219 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 60 | 72 | 86 | 128 | 216 | 97 | 57 | 210 |
| N.S. | 1 | 1.00 | 0.81 | 0.97 | 1.16 | 1.73 | 2.92 | 1.31 | 0.77 | 2.84 |
| time (sec) |
N/A | 0.012 | 0.059 | 0.094 | 0.351 | 0.317 | 2.571 | 0.001 | 0.045 | 95.098 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 42 | 42 | 42 | 35 | 34 | 124 | 437 | 48 | 34 | 311 |
| N.S. | 1 | 1.00 | 1.00 | 0.83 | 0.81 | 2.95 | 10.40 | 1.14 | 0.81 | 7.40 |
| time (sec) |
N/A | 0.008 | 0.027 | 0.094 | 0.352 | 0.310 | 1.005 | 0.002 | 0.095 | 4.465 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 62 | 62 | 51 | 61 | 67 | 164 | 156 | 89 | 52 | 0 |
| N.S. |
1 | 1.00 | 0.82 | 0.98 | 1.08 | 2.65 | 2.52 | 1.44 | 0.84 | 0.00 |
| time (sec) |
N/A | 0.011 | 0.057 | 0.103 | 0.368 | 0.313 | 1.814 | 0.002 | 0.063 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 95 | 95 | 71 | 77 | 104 | 198 | 226 | 115 | 101 | 0 |
| N.S. |
1 | 1.00 | 0.75 | 0.81 | 1.09 | 2.08 | 2.38 | 1.21 | 1.06 | 0.00 |
| time (sec) |
N/A | 0.016 | 0.086 | 0.103 | 0.364 | 0.324 | 4.046 | 0.002 | 0.132 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 60 | 60 | 52 | 49 | 42 | 182 | 1950 | 68 | 48 | 1070 |
| N.S. | 1 | 1.00 | 0.87 | 0.82 | 0.70 | 3.03 | 32.50 | 1.13 | 0.80 | 17.83 |
| time (sec) |
N/A | 0.012 | 0.052 | 0.097 | 0.379 | 0.322 | 104.416 | 0.002 | 0.092 | 9.946 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-1) | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 67 | 74 | 82 | 226 | 0 | 101 | 70 | 1219 |
| N.S. |
1 | 1.00 | 0.83 | 0.91 | 1.01 | 2.79 | 0.00 | 1.25 | 0.86 | 15.05 |
| time (sec) |
N/A | 0.016 | 0.076 | 0.128 | 0.356 | 0.317 | 0.000 | 0.003 | 0.118 | 12.203 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 116 | 116 | 82 | 90 | 121 | 260 | 1108 | 138 | 117 | 0 |
| N.S. |
1 | 1.00 | 0.71 | 0.78 | 1.04 | 2.24 | 9.55 | 1.19 | 1.01 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.116 | 0.117 | 0.346 | 0.328 | 13.203 | 0.004 | 0.071 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | F | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 13 | 13 | 13 | 12 | 11 | 14 | 78 | 0 | 11 | 69 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.85 | 1.08 | 6.00 | 0.00 | 0.85 | 5.31 |
| time (sec) |
N/A | 0.006 | 0.218 | 0.088 | 0.314 | 0.314 | 39.314 | 0.000 | 0.413 | 35.472 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | C | A | F | A | A | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 13 | 92 | 13 | 0 | 11 | 11 | 73 | 0 | -1 | 64 |
| N.S. | 1 | 7.08 | 1.00 | 0.00 | 0.85 | 0.85 | 5.62 | 0.00 | -0.08 | 4.92 |
| time (sec) |
N/A | 0.030 | 0.011 | 0.039 | 0.302 | 0.314 | 2.796 | 0.000 | 0.000 | 4.381 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 23 | 18 | 32 | 56 | 24 | 27 | 17 | 16 |
| N.S. | 1 | 1.00 | 1.00 | 0.78 | 1.39 | 2.43 | 1.04 | 1.17 | 0.74 | 0.70 |
| time (sec) |
N/A | 0.006 | 0.002 | 0.107 | 0.350 | 0.315 | 0.493 | 0.001 | 0.002 | 1.991 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 46 | 50 | 56 | 53 | 1742 | 192 | 56 | 320 |
| N.S. | 1 | 1.00 | 0.64 | 0.69 | 0.78 | 0.74 | 24.19 | 2.67 | 0.78 | 4.44 |
| time (sec) |
N/A | 0.012 | 0.021 | 0.099 | 0.257 | 0.309 | 1.314 | 0.002 | 0.052 | 15.916 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 35 | 38 | 41 | 42 | 666 | 147 | 37 | 197 |
| N.S. | 1 | 1.00 | 0.66 | 0.72 | 0.77 | 0.79 | 12.57 | 2.77 | 0.70 | 3.72 |
| time (sec) |
N/A | 0.009 | 0.018 | 0.095 | 0.272 | 0.300 | 0.889 | 0.001 | 0.038 | 7.133 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 34 | 26 | 26 | 30 | 202 | 98 | 25 | 96 |
| N.S. | 1 | 1.00 | 1.00 | 0.76 | 0.76 | 0.88 | 5.94 | 2.88 | 0.74 | 2.82 |
| time (sec) |
N/A | 0.006 | 0.014 | 0.109 | 0.260 | 0.319 | 0.587 | 0.001 | 0.028 | 3.426 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 12 | 12 | 21 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 0.75 | 0.75 | 1.31 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.001 | 0.006 | 0.107 | 0.264 | 0.303 | 0.029 | 0.000 | 0.017 | 1.565 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 91 | 91 | 113 | 90 | 86 | 91 | 180 | 135 | 107 | 102 |
| N.S. | 1 | 1.00 | 1.24 | 0.99 | 0.95 | 1.00 | 1.98 | 1.48 | 1.18 | 1.12 |
| time (sec) |
N/A | 0.044 | 0.066 | 0.099 | 0.356 | 0.309 | 1.069 | 0.005 | 0.121 | 3.716 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 97 | 97 | 119 | 95 | 93 | 139 | 643 | 164 | 117 | 110 |
| N.S. | 1 | 1.00 | 1.23 | 0.98 | 0.96 | 1.43 | 6.63 | 1.69 | 1.21 | 1.13 |
| time (sec) |
N/A | 0.025 | 0.126 | 0.149 | 0.361 | 0.326 | 1.150 | 0.007 | 0.067 | 7.204 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 127 | 127 | 129 | 118 | 139 | 187 | 2266 | 199 | 196 | 136 |
| N.S. | 1 | 1.00 | 1.02 | 0.93 | 1.09 | 1.47 | 17.84 | 1.57 | 1.54 | 1.07 |
| time (sec) |
N/A | 0.035 | 0.185 | 0.139 | 0.348 | 0.309 | 1.710 | 0.007 | 0.230 | 21.043 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 46 | 50 | 56 | 53 | 1742 | 217 | 56 | 0 |
| N.S. |
1 | 1.00 | 0.64 | 0.69 | 0.78 | 0.74 | 24.19 | 3.01 | 0.78 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.022 | 0.107 | 0.274 | 0.308 | 1.383 | 0.003 | 0.045 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 35 | 38 | 41 | 42 | 666 | 166 | 37 | 194 |
| N.S. | 1 | 1.00 | 0.66 | 0.72 | 0.77 | 0.79 | 12.57 | 3.13 | 0.70 | 3.66 |
| time (sec) |
N/A | 0.009 | 0.019 | 0.109 | 0.278 | 0.303 | 0.922 | 0.002 | 0.041 | 7.407 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 35 | 26 | 26 | 31 | 202 | 113 | 25 | 96 |
| N.S. | 1 | 1.00 | 1.03 | 0.76 | 0.76 | 0.91 | 5.94 | 3.32 | 0.74 | 2.82 |
| time (sec) |
N/A | 0.006 | 0.015 | 0.092 | 0.264 | 0.299 | 0.612 | 0.002 | 0.028 | 3.521 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 12 | 12 | 23 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 0.75 | 0.75 | 1.44 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.001 | 0.007 | 0.089 | 0.269 | 0.304 | 0.029 | 0.000 | 0.018 | 1.616 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 114 | 90 | 85 | 110 | 182 | 147 | 117 | 102 |
| N.S. | 1 | 1.00 | 1.24 | 0.98 | 0.92 | 1.20 | 1.98 | 1.60 | 1.27 | 1.11 |
| time (sec) |
N/A | 0.024 | 0.051 | 0.091 | 0.352 | 0.312 | 1.080 | 0.005 | 0.113 | 3.836 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 94 | 94 | 120 | 95 | 93 | 252 | 643 | 171 | 127 | 112 |
| N.S. | 1 | 1.00 | 1.28 | 1.01 | 0.99 | 2.68 | 6.84 | 1.82 | 1.35 | 1.19 |
| time (sec) |
N/A | 0.026 | 0.116 | 0.100 | 0.357 | 0.317 | 1.171 | 0.007 | 0.114 | 7.319 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 127 | 127 | 147 | 118 | 139 | 350 | 2266 | 211 | 194 | 136 |
| N.S. | 1 | 1.00 | 1.16 | 0.93 | 1.09 | 2.76 | 17.84 | 1.66 | 1.53 | 1.07 |
| time (sec) |
N/A | 0.034 | 0.188 | 0.119 | 0.353 | 0.317 | 1.735 | 0.007 | 0.329 | 21.454 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 46 | 50 | 56 | 64 | 1844 | 325 | 56 | 348 |
| N.S. | 1 | 1.00 | 0.64 | 0.69 | 0.78 | 0.89 | 25.61 | 4.51 | 0.78 | 4.83 |
| time (sec) |
N/A | 0.013 | 0.023 | 0.107 | 0.258 | 0.300 | 1.485 | 0.004 | 0.047 | 17.176 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 35 | 38 | 41 | 53 | 733 | 256 | 37 | 207 |
| N.S. | 1 | 1.00 | 0.66 | 0.72 | 0.77 | 1.00 | 13.83 | 4.83 | 0.70 | 3.91 |
| time (sec) |
N/A | 0.009 | 0.021 | 0.098 | 0.260 | 0.301 | 1.027 | 0.004 | 0.042 | 7.873 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 24 | 26 | 26 | 41 | 80 | 187 | 25 | 53 |
| N.S. | 1 | 1.00 | 0.71 | 0.76 | 0.76 | 1.21 | 2.35 | 5.50 | 0.74 | 1.56 |
| time (sec) |
N/A | 0.006 | 0.016 | 0.108 | 0.274 | 0.316 | 0.225 | 0.003 | 0.027 | 2.067 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 28 | 12 | 112 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 1.75 | 0.75 | 7.00 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.001 | 0.007 | 0.107 | 0.263 | 0.306 | 0.029 | 0.002 | 0.018 | 1.590 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 105 | 105 | 122 | 102 | 96 | 98 | 209 | 158 | 123 | 118 |
| N.S. | 1 | 1.00 | 1.16 | 0.97 | 0.91 | 0.93 | 1.99 | 1.50 | 1.17 | 1.12 |
| time (sec) |
N/A | 0.029 | 0.057 | 0.091 | 0.348 | 0.321 | 1.398 | 0.008 | 0.060 | 4.238 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 107 | 107 | 128 | 106 | 104 | 111 | 719 | 176 | 131 | 125 |
| N.S. | 1 | 1.00 | 1.20 | 0.99 | 0.97 | 1.04 | 6.72 | 1.64 | 1.22 | 1.17 |
| time (sec) |
N/A | 0.030 | 0.150 | 0.151 | 0.360 | 0.312 | 1.508 | 0.009 | 0.073 | 8.332 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 124 | 124 | 136 | 110 | 136 | 162 | 2266 | 198 | 174 | 134 |
| N.S. | 1 | 1.00 | 1.10 | 0.89 | 1.10 | 1.31 | 18.27 | 1.60 | 1.40 | 1.08 |
| time (sec) |
N/A | 0.032 | 0.202 | 0.141 | 0.359 | 0.314 | 1.600 | 0.010 | 0.122 | 21.907 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 46 | 50 | 56 | 42 | 1640 | 95 | 56 | 303 |
| N.S. | 1 | 1.00 | 0.64 | 0.69 | 0.78 | 0.58 | 22.78 | 1.32 | 0.78 | 4.21 |
| time (sec) |
N/A | 0.013 | 0.021 | 0.109 | 0.264 | 0.301 | 1.291 | 0.003 | 0.043 | 15.338 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 35 | 38 | 41 | 31 | 600 | 69 | 37 | 171 |
| N.S. | 1 | 1.00 | 0.66 | 0.72 | 0.77 | 0.58 | 11.32 | 1.30 | 0.70 | 3.23 |
| time (sec) |
N/A | 0.009 | 0.020 | 0.107 | 0.285 | 0.303 | 0.842 | 0.002 | 0.038 | 6.771 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 24 | 26 | 26 | 20 | 162 | 42 | 25 | 74 |
| N.S. | 1 | 1.00 | 0.71 | 0.76 | 0.76 | 0.59 | 4.76 | 1.24 | 0.74 | 2.18 |
| time (sec) |
N/A | 0.006 | 0.013 | 0.122 | 0.275 | 0.318 | 0.566 | 0.001 | 0.029 | 3.186 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 12 | 12 | 17 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 0.75 | 0.75 | 1.06 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.001 | 0.006 | 0.108 | 0.273 | 0.300 | 0.028 | 0.001 | 0.016 | 1.568 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 79 | 79 | 95 | 75 | 76 | 213 | 155 | 137 | 99 | 82 |
| N.S. | 1 | 1.00 | 1.20 | 0.95 | 0.96 | 2.70 | 1.96 | 1.73 | 1.25 | 1.04 |
| time (sec) |
N/A | 0.018 | 0.039 | 0.110 | 0.352 | 0.319 | 0.936 | 0.004 | 0.086 | 3.459 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 120 | 104 | 106 | 306 | 831 | 185 | 130 | 120 |
| N.S. | 1 | 1.00 | 1.20 | 1.04 | 1.06 | 3.06 | 8.31 | 1.85 | 1.30 | 1.20 |
| time (sec) |
N/A | 0.024 | 0.127 | 0.115 | 0.344 | 0.324 | 1.228 | 0.005 | 0.137 | 9.775 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 130 | 130 | 149 | 130 | 142 | 296 | 2730 | 218 | 182 | 139 |
| N.S. | 1 | 1.00 | 1.15 | 1.00 | 1.09 | 2.28 | 21.00 | 1.68 | 1.40 | 1.07 |
| time (sec) |
N/A | 0.032 | 0.121 | 0.112 | 0.373 | 0.330 | 2.141 | 0.006 | 0.226 | 26.899 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 80 | 80 | 48 | 58 | 64 | 44 | 4974 | 100 | 64 | 2502 |
| N.S. | 1 | 1.00 | 0.60 | 0.72 | 0.80 | 0.55 | 62.18 | 1.25 | 0.80 | 31.28 |
| time (sec) |
N/A | 0.013 | 0.021 | 0.108 | 0.257 | 0.297 | 1.368 | 0.002 | 0.048 | 23.056 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 59 | 59 | 37 | 44 | 47 | 33 | 1326 | 73 | 43 | 837 |
| N.S. | 1 | 1.00 | 0.63 | 0.75 | 0.80 | 0.56 | 22.47 | 1.24 | 0.73 | 14.19 |
| time (sec) |
N/A | 0.009 | 0.023 | 0.108 | 0.266 | 0.294 | 0.909 | 0.002 | 0.040 | 6.983 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 26 | 30 | 30 | 22 | 486 | 44 | 29 | 308 |
| N.S. | 1 | 1.00 | 0.68 | 0.79 | 0.79 | 0.58 | 12.79 | 1.16 | 0.76 | 8.11 |
| time (sec) |
N/A | 0.006 | 0.013 | 0.100 | 0.267 | 0.300 | 0.622 | 0.001 | 0.029 | 3.959 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 18 | 18 | 18 | 15 | 14 | 14 | 12 | 18 | 14 | 14 |
| N.S. | 1 | 1.00 | 1.00 | 0.83 | 0.78 | 0.78 | 0.67 | 1.00 | 0.78 | 0.78 |
| time (sec) |
N/A | 0.001 | 0.006 | 0.106 | 0.265 | 0.309 | 0.030 | 0.001 | 0.020 | 1.574 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 100 | 83 | 86 | 285 | 160 | 152 | 117 | 91 |
| N.S. | 1 | 1.00 | 1.22 | 1.01 | 1.05 | 3.48 | 1.95 | 1.85 | 1.43 | 1.11 |
| time (sec) |
N/A | 0.023 | 0.059 | 0.114 | 0.357 | 0.327 | 0.969 | 0.004 | 0.095 | 3.599 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 103 | 103 | 128 | 113 | 116 | 328 | 838 | 197 | 133 | 0 |
| N.S. |
1 | 1.00 | 1.24 | 1.10 | 1.13 | 3.18 | 8.14 | 1.91 | 1.29 | 0.00 |
| time (sec) |
N/A | 0.024 | 0.105 | 0.121 | 0.344 | 0.325 | 1.259 | 0.005 | 0.175 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 160 | 141 | 159 | 374 | 2744 | 234 | 216 | 148 |
| N.S. | 1 | 1.00 | 1.18 | 1.04 | 1.17 | 2.75 | 20.18 | 1.72 | 1.59 | 1.09 |
| time (sec) |
N/A | 0.031 | 0.106 | 0.105 | 0.356 | 0.324 | 2.173 | 0.006 | 0.220 | 28.131 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 70 | 70 | 46 | 50 | 56 | 42 | 1640 | 85 | 56 | 299 |
| N.S. | 1 | 1.00 | 0.66 | 0.71 | 0.80 | 0.60 | 23.43 | 1.21 | 0.80 | 4.27 |
| time (sec) |
N/A | 0.013 | 0.022 | 0.111 | 0.273 | 0.294 | 1.299 | 0.002 | 0.045 | 15.194 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 35 | 37 | 41 | 31 | 600 | 60 | 37 | 162 |
| N.S. | 1 | 1.00 | 0.69 | 0.73 | 0.80 | 0.61 | 11.76 | 1.18 | 0.73 | 3.18 |
| time (sec) |
N/A | 0.009 | 0.019 | 0.109 | 0.269 | 0.305 | 0.870 | 0.002 | 0.041 | 6.748 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 23 | 26 | 26 | 19 | 162 | 36 | 25 | 73 |
| N.S. | 1 | 1.00 | 0.72 | 0.81 | 0.81 | 0.59 | 5.06 | 1.12 | 0.78 | 2.28 |
| time (sec) |
N/A | 0.006 | 0.012 | 0.108 | 0.257 | 0.304 | 0.579 | 0.002 | 0.029 | 3.192 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 12 | 10 | 13 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 0.86 | 0.71 | 0.93 | 0.86 | 0.86 |
| time (sec) |
N/A | 0.001 | 0.005 | 0.115 | 0.261 | 0.300 | 0.029 | 0.001 | 0.017 | 1.578 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 80 | 80 | 93 | 76 | 77 | 115 | 150 | 129 | 95 | 82 |
| N.S. | 1 | 1.00 | 1.16 | 0.95 | 0.96 | 1.44 | 1.88 | 1.61 | 1.19 | 1.02 |
| time (sec) |
N/A | 0.018 | 0.046 | 0.111 | 0.357 | 0.320 | 0.978 | 0.003 | 0.166 | 3.490 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 98 | 98 | 119 | 104 | 106 | 166 | 830 | 178 | 122 | 112 |
| N.S. | 1 | 1.00 | 1.21 | 1.06 | 1.08 | 1.69 | 8.47 | 1.82 | 1.24 | 1.14 |
| time (sec) |
N/A | 0.024 | 0.114 | 0.133 | 0.346 | 0.317 | 1.258 | 0.004 | 0.130 | 9.159 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 130 | 130 | 149 | 130 | 142 | 162 | 2728 | 215 | 175 | 153 |
| N.S. | 1 | 1.00 | 1.15 | 1.00 | 1.09 | 1.25 | 20.98 | 1.65 | 1.35 | 1.18 |
| time (sec) |
N/A | 0.034 | 0.116 | 0.148 | 0.353 | 0.313 | 2.205 | 0.004 | 0.131 | 25.885 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 70 | 70 | 46 | 49 | 56 | 52 | 1538 | 97 | 56 | 277 |
| N.S. | 1 | 1.00 | 0.66 | 0.70 | 0.80 | 0.74 | 21.97 | 1.39 | 0.80 | 3.96 |
| time (sec) |
N/A | 0.013 | 0.022 | 0.123 | 0.266 | 0.304 | 1.377 | 0.002 | 0.053 | 14.772 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 34 | 38 | 41 | 40 | 534 | 67 | 35 | 144 |
| N.S. | 1 | 1.00 | 0.69 | 0.78 | 0.84 | 0.82 | 10.90 | 1.37 | 0.71 | 2.94 |
| time (sec) |
N/A | 0.009 | 0.021 | 0.126 | 0.284 | 0.298 | 0.919 | 0.002 | 0.042 | 6.284 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 23 | 25 | 26 | 29 | 41 | 38 | 20 | 33 |
| N.S. | 1 | 1.00 | 0.72 | 0.78 | 0.81 | 0.91 | 1.28 | 1.19 | 0.62 | 1.03 |
| time (sec) |
N/A | 0.006 | 0.013 | 0.115 | 0.266 | 0.306 | 0.312 | 0.001 | 0.030 | 1.856 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 20 | 12 | 15 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 1.43 | 0.86 | 1.07 | 0.86 | 0.86 |
| time (sec) |
N/A | 0.001 | 0.008 | 0.113 | 0.264 | 0.300 | 0.030 | 0.001 | 0.021 | 1.566 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 93 | 93 | 111 | 95 | 88 | 285 | 184 | 156 | 114 | 131 |
| N.S. | 1 | 1.00 | 1.19 | 1.02 | 0.95 | 3.06 | 1.98 | 1.68 | 1.23 | 1.41 |
| time (sec) |
N/A | 0.025 | 0.080 | 0.112 | 0.356 | 0.315 | 1.116 | 0.005 | 0.056 | 3.878 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 113 | 113 | 123 | 112 | 122 | 407 | 857 | 204 | 173 | 173 |
| N.S. | 1 | 1.00 | 1.09 | 0.99 | 1.08 | 3.60 | 7.58 | 1.81 | 1.53 | 1.53 |
| time (sec) |
N/A | 0.032 | 0.189 | 0.112 | 0.340 | 0.318 | 1.609 | 0.007 | 0.068 | 9.855 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 149 | 149 | 142 | 126 | 158 | 407 | 2793 | 236 | 221 | 1120 |
| N.S. | 1 | 1.00 | 0.95 | 0.85 | 1.06 | 2.73 | 18.74 | 1.58 | 1.48 | 7.52 |
| time (sec) |
N/A | 0.042 | 0.247 | 0.131 | 0.362 | 0.324 | 3.388 | 0.008 | 0.131 | 30.564 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 71 | 71 | 97 | 86 | 86 | 88 | 138 | 103 | 105 | 95 |
| N.S. | 1 | 1.00 | 1.37 | 1.21 | 1.21 | 1.24 | 1.94 | 1.45 | 1.48 | 1.34 |
| time (sec) |
N/A | 0.024 | 0.050 | 0.120 | 0.343 | 0.325 | 1.049 | 0.002 | 0.101 | 3.701 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 73 | 73 | 101 | 90 | 90 | 92 | 136 | 107 | 108 | 98 |
| N.S. | 1 | 1.00 | 1.38 | 1.23 | 1.23 | 1.26 | 1.86 | 1.47 | 1.48 | 1.34 |
| time (sec) |
N/A | 0.023 | 0.051 | 0.117 | 0.357 | 0.351 | 1.044 | 0.002 | 0.128 | 3.749 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 102 | 96 | 94 | 93 | 134 | 108 | 112 | 96 |
| N.S. | 1 | 1.00 | 1.38 | 1.30 | 1.27 | 1.26 | 1.81 | 1.46 | 1.51 | 1.30 |
| time (sec) |
N/A | 0.022 | 0.052 | 0.099 | 0.361 | 0.310 | 1.100 | 0.002 | 0.108 | 3.746 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 76 | 76 | 106 | 100 | 98 | 97 | 139 | 112 | 115 | 93 |
| N.S. | 1 | 1.00 | 1.39 | 1.32 | 1.29 | 1.28 | 1.83 | 1.47 | 1.51 | 1.22 |
| time (sec) |
N/A | 0.021 | 0.067 | 0.118 | 0.350 | 0.310 | 0.959 | 0.002 | 0.072 | 3.623 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 95 | 87 | 87 | 86 | 134 | 110 | 101 | 82 |
| N.S. | 1 | 1.00 | 1.32 | 1.21 | 1.21 | 1.19 | 1.86 | 1.53 | 1.40 | 1.14 |
| time (sec) |
N/A | 0.018 | 0.046 | 0.118 | 0.357 | 0.322 | 0.953 | 0.003 | 0.141 | 3.473 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 99 | 91 | 91 | 90 | 136 | 114 | 104 | 89 |
| N.S. | 1 | 1.00 | 1.34 | 1.23 | 1.23 | 1.22 | 1.84 | 1.54 | 1.41 | 1.20 |
| time (sec) |
N/A | 0.018 | 0.039 | 0.115 | 0.352 | 0.314 | 0.981 | 0.003 | 0.107 | 3.595 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 102 | 95 | 93 | 95 | 134 | 114 | 107 | 89 |
| N.S. | 1 | 1.00 | 1.38 | 1.28 | 1.26 | 1.28 | 1.81 | 1.54 | 1.45 | 1.20 |
| time (sec) |
N/A | 0.017 | 0.039 | 0.119 | 0.340 | 0.317 | 0.979 | 0.003 | 0.156 | 3.571 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 76 | 76 | 106 | 99 | 97 | 99 | 133 | 118 | 110 | 82 |
| N.S. | 1 | 1.00 | 1.39 | 1.30 | 1.28 | 1.30 | 1.75 | 1.55 | 1.45 | 1.08 |
| time (sec) |
N/A | 0.019 | 0.040 | 0.117 | 0.352 | 0.312 | 0.968 | 0.003 | 0.160 | 3.465 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 25 | 25 | 22 | 30 | 25 | 33 | 87 | 50 | 30 | 101 |
| N.S. | 1 | 1.00 | 0.88 | 1.20 | 1.00 | 1.32 | 3.48 | 2.00 | 1.20 | 4.04 |
| time (sec) |
N/A | 0.006 | 0.021 | 0.012 | 0.261 | 0.312 | 0.130 | 0.001 | 0.313 | 1.700 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 17 | 14 | 13 | 18 | 19 | 27 | 13 | 13 |
| N.S. | 1 | 1.00 | 0.81 | 0.67 | 0.62 | 0.86 | 0.90 | 1.29 | 0.62 | 0.62 |
| time (sec) |
N/A | 0.003 | 0.009 | 0.047 | 0.263 | 0.295 | 0.245 | 0.000 | 0.091 | 1.759 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 17 | 14 | 13 | 18 | 19 | 27 | 13 | 13 |
| N.S. | 1 | 1.00 | 0.81 | 0.67 | 0.62 | 0.86 | 0.90 | 1.29 | 0.62 | 0.62 |
| time (sec) |
N/A | 0.003 | 0.009 | 0.047 | 0.258 | 0.307 | 0.135 | 0.000 | 0.027 | 1.646 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 17 | 14 | 13 | 16 | 19 | 25 | 13 | 13 |
| N.S. | 1 | 1.00 | 0.81 | 0.67 | 0.62 | 0.76 | 0.90 | 1.19 | 0.62 | 0.62 |
| time (sec) |
N/A | 0.003 | 0.008 | 0.047 | 0.269 | 0.299 | 0.726 | 0.000 | 0.025 | 2.127 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 16 | 14 | 13 | 12 | 17 | 20 | 12 | 12 |
| N.S. | 1 | 1.00 | 0.84 | 0.74 | 0.68 | 0.63 | 0.89 | 1.05 | 0.63 | 0.63 |
| time (sec) |
N/A | 0.003 | 0.008 | 0.020 | 0.257 | 0.303 | 0.070 | 0.000 | 0.025 | 1.606 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 13 | 14 | 13 | 12 | 15 | 19 | 11 | 12 |
| N.S. | 1 | 1.00 | 0.76 | 0.82 | 0.76 | 0.71 | 0.88 | 1.12 | 0.65 | 0.71 |
| time (sec) |
N/A | 0.003 | 0.010 | 0.026 | 0.257 | 0.301 | 0.159 | 0.001 | 0.028 | 1.609 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 15 | 14 | 11 | 11 | 19 | 21 | 13 | 13 |
| N.S. | 1 | 1.00 | 0.79 | 0.74 | 0.58 | 0.58 | 1.00 | 1.11 | 0.68 | 0.68 |
| time (sec) |
N/A | 0.003 | 0.011 | 0.025 | 0.259 | 0.544 | 0.217 | 0.001 | 0.027 | 1.669 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 38 | 51 | 43 | 85 | 299 | 134 | 93 | 311 |
| N.S. | 1 | 1.00 | 0.88 | 1.19 | 1.00 | 1.98 | 6.95 | 3.12 | 2.16 | 7.23 |
| time (sec) |
N/A | 0.011 | 0.037 | 0.087 | 0.260 | 0.322 | 0.193 | 0.002 | 0.416 | 1.977 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 28 | 25 | 24 | 29 | 34 | 45 | 24 | 24 |
| N.S. | 1 | 1.00 | 0.78 | 0.69 | 0.67 | 0.81 | 0.94 | 1.25 | 0.67 | 0.67 |
| time (sec) |
N/A | 0.005 | 0.013 | 0.087 | 0.265 | 0.320 | 0.331 | 0.001 | 0.103 | 1.852 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 28 | 25 | 24 | 29 | 34 | 45 | 24 | 24 |
| N.S. | 1 | 1.00 | 0.78 | 0.69 | 0.67 | 0.81 | 0.94 | 1.25 | 0.67 | 0.67 |
| time (sec) |
N/A | 0.005 | 0.012 | 0.088 | 0.257 | 0.301 | 0.187 | 0.001 | 0.035 | 1.743 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 28 | 25 | 24 | 27 | 1851 | 43 | 24 | 1012 |
| N.S. | 1 | 1.00 | 0.78 | 0.69 | 0.67 | 0.75 | 51.42 | 1.19 | 0.67 | 28.11 |
| time (sec) |
N/A | 0.005 | 0.012 | 0.092 | 0.265 | 0.309 | 65.396 | 0.001 | 0.042 | 11.024 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 28 | 25 | 24 | 24 | 32 | 38 | 24 | 24 |
| N.S. | 1 | 1.00 | 0.82 | 0.74 | 0.71 | 0.71 | 0.94 | 1.12 | 0.71 | 0.71 |
| time (sec) |
N/A | 0.005 | 0.012 | 0.089 | 0.258 | 0.307 | 0.098 | 0.001 | 0.037 | 1.673 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 28 | 25 | 24 | 23 | 31 | 35 | 24 | 21 |
| N.S. | 1 | 1.00 | 0.88 | 0.78 | 0.75 | 0.72 | 0.97 | 1.09 | 0.75 | 0.66 |
| time (sec) |
N/A | 0.006 | 0.014 | 0.095 | 0.266 | 0.304 | 0.187 | 0.001 | 0.035 | 1.695 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 26 | 25 | 23 | 24 | 31 | 35 | 24 | 24 |
| N.S. | 1 | 1.00 | 0.81 | 0.78 | 0.72 | 0.75 | 0.97 | 1.09 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.005 | 0.016 | 0.089 | 0.268 | 0.313 | 0.226 | 0.001 | 0.030 | 1.716 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 54 | 72 | 61 | 157 | 663 | 255 | 167 | 662 |
| N.S. | 1 | 1.00 | 0.89 | 1.18 | 1.00 | 2.57 | 10.87 | 4.18 | 2.74 | 10.85 |
| time (sec) |
N/A | 0.014 | 0.037 | 0.089 | 0.278 | 0.309 | 0.280 | 0.003 | 0.389 | 2.468 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 39 | 36 | 35 | 40 | 49 | 63 | 35 | 35 |
| N.S. | 1 | 1.00 | 0.76 | 0.71 | 0.69 | 0.78 | 0.96 | 1.24 | 0.69 | 0.69 |
| time (sec) |
N/A | 0.008 | 0.015 | 0.090 | 0.259 | 0.297 | 0.430 | 0.001 | 0.045 | 1.995 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 39 | 36 | 35 | 40 | 49 | 63 | 35 | 35 |
| N.S. | 1 | 1.00 | 0.76 | 0.71 | 0.69 | 0.78 | 0.96 | 1.24 | 0.69 | 0.69 |
| time (sec) |
N/A | 0.008 | 0.014 | 0.087 | 0.261 | 0.314 | 0.253 | 0.001 | 0.046 | 1.867 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-1) | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 39 | 36 | 35 | 38 | 0 | 61 | 35 | 2556 |
| N.S. |
1 | 1.00 | 0.76 | 0.71 | 0.69 | 0.75 | 0.00 | 1.20 | 0.69 | 50.12 |
| time (sec) |
N/A | 0.008 | 0.014 | 0.087 | 0.249 | 0.300 | 0.000 | 0.001 | 0.042 | 27.146 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 39 | 36 | 35 | 35 | 46 | 56 | 35 | 35 |
| N.S. | 1 | 1.00 | 0.83 | 0.77 | 0.74 | 0.74 | 0.98 | 1.19 | 0.74 | 0.74 |
| time (sec) |
N/A | 0.008 | 0.014 | 0.110 | 0.258 | 0.308 | 0.130 | 0.001 | 0.043 | 1.757 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 39 | 36 | 35 | 34 | 44 | 51 | 35 | 32 |
| N.S. | 1 | 1.00 | 0.87 | 0.80 | 0.78 | 0.76 | 0.98 | 1.13 | 0.78 | 0.71 |
| time (sec) |
N/A | 0.008 | 0.017 | 0.096 | 0.260 | 0.300 | 0.222 | 0.001 | 0.047 | 1.762 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 38 | 36 | 34 | 34 | 46 | 51 | 35 | 32 |
| N.S. | 1 | 1.00 | 0.81 | 0.77 | 0.72 | 0.72 | 0.98 | 1.09 | 0.74 | 0.68 |
| time (sec) |
N/A | 0.008 | 0.017 | 0.090 | 0.291 | 0.305 | 0.254 | 0.001 | 0.039 | 1.793 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 61 | 54 | 54 | 132 | 122 | 85 | 48 | 126 |
| N.S. | 1 | 1.00 | 0.90 | 0.79 | 0.79 | 1.94 | 1.79 | 1.25 | 0.71 | 1.85 |
| time (sec) |
N/A | 0.023 | 0.045 | 0.105 | 0.353 | 0.334 | 2.998 | 0.001 | 0.057 | 4.382 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 49 | 43 | 42 | 103 | 107 | 65 | 37 | 115 |
| N.S. | 1 | 1.00 | 0.92 | 0.81 | 0.79 | 1.94 | 2.02 | 1.23 | 0.70 | 2.17 |
| time (sec) |
N/A | 0.012 | 0.034 | 0.101 | 0.337 | 0.314 | 0.746 | 0.002 | 0.052 | 2.194 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 40 | 40 | 40 | 32 | 31 | 85 | 88 | 43 | 28 | 102 |
| N.S. | 1 | 1.00 | 1.00 | 0.80 | 0.78 | 2.12 | 2.20 | 1.08 | 0.70 | 2.55 |
| time (sec) |
N/A | 0.009 | 0.020 | 0.102 | 0.351 | 0.312 | 0.355 | 0.001 | 0.041 | 1.833 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 29 | 19 | 18 | 68 | 73 | 26 | 19 | 92 |
| N.S. | 1 | 1.00 | 1.00 | 0.66 | 0.62 | 2.34 | 2.52 | 0.90 | 0.66 | 3.17 |
| time (sec) |
N/A | 0.006 | 0.014 | 0.098 | 0.351 | 0.313 | 0.470 | 0.001 | 0.044 | 1.966 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 40 | 40 | 40 | 32 | 31 | 93 | 85 | 45 | 28 | 100 |
| N.S. | 1 | 1.00 | 1.00 | 0.80 | 0.78 | 2.32 | 2.12 | 1.12 | 0.70 | 2.50 |
| time (sec) |
N/A | 0.009 | 0.024 | 0.121 | 0.339 | 0.317 | 1.029 | 0.001 | 0.044 | 2.527 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 48 | 43 | 41 | 118 | 107 | 60 | 38 | 111 |
| N.S. | 1 | 1.00 | 0.91 | 0.81 | 0.77 | 2.23 | 2.02 | 1.13 | 0.72 | 2.09 |
| time (sec) |
N/A | 0.012 | 0.036 | 0.107 | 0.339 | 0.313 | 3.568 | 0.001 | 0.102 | 3.532 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 61 | 54 | 52 | 144 | 126 | 77 | 49 | 126 |
| N.S. | 1 | 1.00 | 0.90 | 0.79 | 0.76 | 2.12 | 1.85 | 1.13 | 0.72 | 1.85 |
| time (sec) |
N/A | 0.016 | 0.045 | 0.106 | 0.371 | 0.315 | 14.711 | 0.001 | 0.110 | 15.582 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 70 | 70 | 68 | 59 | 63 | 161 | 389 | 90 | 58 | 386 |
| N.S. | 1 | 1.00 | 0.97 | 0.84 | 0.90 | 2.30 | 5.56 | 1.29 | 0.83 | 5.51 |
| time (sec) |
N/A | 0.016 | 0.074 | 0.118 | 0.361 | 0.309 | 14.134 | 0.002 | 0.114 | 15.364 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 54 | 47 | 49 | 134 | 332 | 66 | 46 | 332 |
| N.S. | 1 | 1.00 | 0.95 | 0.82 | 0.86 | 2.35 | 5.82 | 1.16 | 0.81 | 5.82 |
| time (sec) |
N/A | 0.012 | 0.065 | 0.130 | 0.362 | 0.313 | 3.872 | 0.002 | 0.124 | 5.269 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 46 | 46 | 46 | 37 | 37 | 115 | 269 | 49 | 34 | 276 |
| N.S. | 1 | 1.00 | 1.00 | 0.80 | 0.80 | 2.50 | 5.85 | 1.07 | 0.74 | 6.00 |
| time (sec) |
N/A | 0.009 | 0.050 | 0.102 | 0.347 | 0.630 | 1.697 | 0.002 | 0.040 | 3.107 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 45 | 36 | 35 | 116 | 277 | 48 | 33 | 281 |
| N.S. | 1 | 1.00 | 1.00 | 0.80 | 0.78 | 2.58 | 6.16 | 1.07 | 0.73 | 6.24 |
| time (sec) |
N/A | 0.009 | 0.046 | 0.095 | 0.356 | 0.316 | 2.755 | 0.001 | 0.095 | 4.126 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 56 | 56 | 54 | 47 | 51 | 147 | 384 | 71 | 48 | 358 |
| N.S. | 1 | 1.00 | 0.96 | 0.84 | 0.91 | 2.62 | 6.86 | 1.27 | 0.86 | 6.39 |
| time (sec) |
N/A | 0.012 | 0.066 | 0.112 | 0.342 | 0.315 | 7.381 | 0.001 | 0.124 | 8.477 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 69 | 69 | 68 | 58 | 64 | 184 | 452 | 81 | 58 | 419 |
| N.S. | 1 | 1.00 | 0.99 | 0.84 | 0.93 | 2.67 | 6.55 | 1.17 | 0.84 | 6.07 |
| time (sec) |
N/A | 0.016 | 0.067 | 0.114 | 0.371 | 0.316 | 29.693 | 0.001 | 0.150 | 18.278 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 95 | 95 | 81 | 68 | 86 | 227 | 762 | 110 | 81 | 738 |
| N.S. | 1 | 1.00 | 0.85 | 0.72 | 0.91 | 2.39 | 8.02 | 1.16 | 0.85 | 7.77 |
| time (sec) |
N/A | 0.022 | 0.111 | 0.132 | 0.344 | 0.311 | 93.791 | 0.002 | 0.122 | 92.821 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 70 | 56 | 73 | 200 | 683 | 85 | 69 | 665 |
| N.S. | 1 | 1.00 | 0.85 | 0.68 | 0.89 | 2.44 | 8.33 | 1.04 | 0.84 | 8.11 |
| time (sec) |
N/A | 0.016 | 0.102 | 0.115 | 0.366 | 0.326 | 34.876 | 0.002 | 0.143 | 34.872 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 70 | 70 | 59 | 50 | 61 | 185 | 605 | 72 | 58 | 590 |
| N.S. | 1 | 1.00 | 0.84 | 0.71 | 0.87 | 2.64 | 8.64 | 1.03 | 0.83 | 8.43 |
| time (sec) |
N/A | 0.013 | 0.100 | 0.099 | 0.351 | 0.313 | 16.536 | 0.002 | 0.131 | 17.350 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 73 | 73 | 60 | 52 | 64 | 186 | 627 | 68 | 56 | 612 |
| N.S. | 1 | 1.00 | 0.82 | 0.71 | 0.88 | 2.55 | 8.59 | 0.93 | 0.77 | 8.38 |
| time (sec) |
N/A | 0.014 | 0.095 | 0.129 | 0.340 | 0.310 | 7.171 | 0.002 | 0.125 | 6.824 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 70 | 70 | 59 | 59 | 60 | 186 | 632 | 70 | 57 | 614 |
| N.S. | 1 | 1.00 | 0.84 | 0.84 | 0.86 | 2.66 | 9.03 | 1.00 | 0.81 | 8.77 |
| time (sec) |
N/A | 0.014 | 0.066 | 0.108 | 0.334 | 0.324 | 11.763 | 0.001 | 0.126 | 12.604 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 70 | 56 | 73 | 214 | 779 | 89 | 70 | 706 |
| N.S. | 1 | 1.00 | 0.85 | 0.68 | 0.89 | 2.61 | 9.50 | 1.09 | 0.85 | 8.61 |
| time (sec) |
N/A | 0.016 | 0.098 | 0.115 | 0.351 | 0.323 | 31.395 | 0.002 | 0.149 | 31.459 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 95 | 95 | 81 | 67 | 86 | 250 | 869 | 100 | 80 | 786 |
| N.S. | 1 | 1.00 | 0.85 | 0.71 | 0.91 | 2.63 | 9.15 | 1.05 | 0.84 | 8.27 |
| time (sec) |
N/A | 0.021 | 0.099 | 0.134 | 0.357 | 0.324 | 81.483 | 0.002 | 0.155 | 43.447 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 61 | 54 | 70 | 131 | 117 | 90 | 51 | 122 |
| N.S. | 1 | 1.00 | 0.90 | 0.79 | 1.03 | 1.93 | 1.72 | 1.32 | 0.75 | 1.79 |
| time (sec) |
N/A | 0.017 | 0.044 | 0.124 | 0.346 | 0.308 | 3.001 | 0.002 | 0.147 | 3.622 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 49 | 43 | 58 | 103 | 102 | 70 | 37 | 111 |
| N.S. | 1 | 1.00 | 0.92 | 0.81 | 1.09 | 1.94 | 1.92 | 1.32 | 0.70 | 2.09 |
| time (sec) |
N/A | 0.013 | 0.036 | 0.119 | 0.351 | 0.623 | 0.741 | 0.001 | 0.114 | 2.227 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 40 | 40 | 40 | 32 | 47 | 83 | 83 | 47 | 28 | 98 |
| N.S. | 1 | 1.00 | 1.00 | 0.80 | 1.18 | 2.08 | 2.08 | 1.18 | 0.70 | 2.45 |
| time (sec) |
N/A | 0.010 | 0.022 | 0.111 | 0.372 | 0.314 | 0.365 | 0.001 | 0.112 | 1.855 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 29 | 19 | 34 | 67 | 68 | 28 | 19 | 88 |
| N.S. | 1 | 1.00 | 1.00 | 0.66 | 1.17 | 2.31 | 2.34 | 0.97 | 0.66 | 3.03 |
| time (sec) |
N/A | 0.007 | 0.014 | 0.095 | 0.365 | 0.315 | 0.465 | 0.001 | 0.125 | 1.970 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 40 | 40 | 40 | 32 | 47 | 91 | 76 | 48 | 28 | 96 |
| N.S. | 1 | 1.00 | 1.00 | 0.80 | 1.18 | 2.28 | 1.90 | 1.20 | 0.70 | 2.40 |
| time (sec) |
N/A | 0.009 | 0.024 | 0.126 | 0.369 | 0.313 | 1.034 | 0.001 | 0.056 | 2.450 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 48 | 43 | 55 | 113 | 99 | 65 | 37 | 107 |
| N.S. | 1 | 1.00 | 0.91 | 0.81 | 1.04 | 2.13 | 1.87 | 1.23 | 0.70 | 2.02 |
| time (sec) |
N/A | 0.012 | 0.041 | 0.103 | 0.355 | 0.682 | 3.493 | 0.001 | 0.122 | 3.598 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 61 | 54 | 68 | 143 | 117 | 81 | 48 | 122 |
| N.S. | 1 | 1.00 | 0.90 | 0.79 | 1.00 | 2.10 | 1.72 | 1.19 | 0.71 | 1.79 |
| time (sec) |
N/A | 0.016 | 0.043 | 0.124 | 0.371 | 0.309 | 14.580 | 0.001 | 0.129 | 15.371 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 70 | 70 | 70 | 60 | 81 | 167 | 354 | 92 | 61 | 365 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 1.16 | 2.39 | 5.06 | 1.31 | 0.87 | 5.21 |
| time (sec) |
N/A | 0.016 | 0.072 | 0.116 | 0.359 | 0.305 | 13.907 | 0.002 | 0.071 | 15.180 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 56 | 48 | 68 | 138 | 301 | 69 | 47 | 314 |
| N.S. | 1 | 1.00 | 0.98 | 0.84 | 1.19 | 2.42 | 5.28 | 1.21 | 0.82 | 5.51 |
| time (sec) |
N/A | 0.013 | 0.058 | 0.130 | 0.335 | 0.303 | 3.893 | 0.002 | 0.115 | 4.676 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 49 | 38 | 56 | 123 | 243 | 52 | 35 | 261 |
| N.S. | 1 | 1.00 | 1.04 | 0.81 | 1.19 | 2.62 | 5.17 | 1.11 | 0.74 | 5.55 |
| time (sec) |
N/A | 0.010 | 0.052 | 0.123 | 0.397 | 0.303 | 1.748 | 0.002 | 0.112 | 3.222 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 46 | 46 | 46 | 37 | 56 | 122 | 252 | 53 | 34 | 266 |
| N.S. | 1 | 1.00 | 1.00 | 0.80 | 1.22 | 2.65 | 5.48 | 1.15 | 0.74 | 5.78 |
| time (sec) |
N/A | 0.010 | 0.047 | 0.106 | 0.334 | 0.310 | 2.743 | 0.001 | 0.055 | 4.193 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 55 | 48 | 69 | 151 | 354 | 74 | 49 | 340 |
| N.S. | 1 | 1.00 | 0.96 | 0.84 | 1.21 | 2.65 | 6.21 | 1.30 | 0.86 | 5.96 |
| time (sec) |
N/A | 0.013 | 0.059 | 0.130 | 0.356 | 0.313 | 7.223 | 0.001 | 0.073 | 7.247 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 70 | 70 | 69 | 59 | 82 | 187 | 416 | 86 | 60 | 398 |
| N.S. | 1 | 1.00 | 0.99 | 0.84 | 1.17 | 2.67 | 5.94 | 1.23 | 0.86 | 5.69 |
| time (sec) |
N/A | 0.017 | 0.075 | 0.109 | 0.379 | 0.308 | 29.130 | 0.002 | 0.138 | 18.118 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 97 | 97 | 82 | 69 | 103 | 227 | 695 | 116 | 83 | 698 |
| N.S. | 1 | 1.00 | 0.85 | 0.71 | 1.06 | 2.34 | 7.16 | 1.20 | 0.86 | 7.20 |
| time (sec) |
N/A | 0.022 | 0.112 | 0.113 | 0.357 | 0.321 | 94.025 | 0.002 | 0.141 | 95.955 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 71 | 57 | 90 | 199 | 624 | 92 | 69 | 629 |
| N.S. | 1 | 1.00 | 0.85 | 0.68 | 1.07 | 2.37 | 7.43 | 1.10 | 0.82 | 7.49 |
| time (sec) |
N/A | 0.017 | 0.109 | 0.141 | 0.345 | 0.317 | 34.691 | 0.003 | 0.065 | 35.486 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 60 | 51 | 78 | 186 | 552 | 77 | 58 | 558 |
| N.S. | 1 | 1.00 | 0.83 | 0.71 | 1.08 | 2.58 | 7.67 | 1.07 | 0.81 | 7.75 |
| time (sec) |
N/A | 0.015 | 0.098 | 0.103 | 0.344 | 0.313 | 16.384 | 0.003 | 0.143 | 17.386 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 75 | 75 | 60 | 53 | 80 | 183 | 575 | 74 | 57 | 580 |
| N.S. | 1 | 1.00 | 0.80 | 0.71 | 1.07 | 2.44 | 7.67 | 0.99 | 0.76 | 7.73 |
| time (sec) |
N/A | 0.014 | 0.085 | 0.112 | 0.341 | 0.316 | 7.098 | 0.002 | 0.137 | 8.410 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 60 | 61 | 77 | 185 | 580 | 77 | 58 | 582 |
| N.S. | 1 | 1.00 | 0.83 | 0.85 | 1.07 | 2.57 | 8.06 | 1.07 | 0.81 | 8.08 |
| time (sec) |
N/A | 0.015 | 0.076 | 0.115 | 0.349 | 0.324 | 11.865 | 0.001 | 0.135 | 9.954 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 71 | 57 | 90 | 213 | 716 | 93 | 69 | 670 |
| N.S. | 1 | 1.00 | 0.85 | 0.68 | 1.07 | 2.54 | 8.52 | 1.11 | 0.82 | 7.98 |
| time (sec) |
N/A | 0.017 | 0.097 | 0.125 | 0.346 | 0.320 | 32.192 | 0.002 | 0.155 | 32.029 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 97 | 97 | 82 | 68 | 103 | 249 | 799 | 108 | 80 | 746 |
| N.S. | 1 | 1.00 | 0.85 | 0.70 | 1.06 | 2.57 | 8.24 | 1.11 | 0.82 | 7.69 |
| time (sec) |
N/A | 0.022 | 0.102 | 0.133 | 0.340 | 0.324 | 85.475 | 0.002 | 0.165 | 44.150 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 122 | 122 | 88 | 128 | 178 | 162 | 153 | 151 | -1 | 135 |
| N.S. | 1 | 1.00 | 0.72 | 1.05 | 1.46 | 1.33 | 1.25 | 1.24 | -0.01 | 1.11 |
| time (sec) |
N/A | 0.031 | 0.109 | 0.115 | 0.349 | 0.340 | 21.950 | 0.007 | 0.000 | 22.001 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 98 | 98 | 77 | 106 | 146 | 141 | 122 | 125 | -1 | 125 |
| N.S. | 1 | 1.00 | 0.79 | 1.08 | 1.49 | 1.44 | 1.24 | 1.28 | -0.01 | 1.28 |
| time (sec) |
N/A | 0.021 | 0.076 | 0.122 | 0.366 | 0.332 | 5.353 | 0.006 | 0.000 | 7.245 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 63 | 84 | 108 | 114 | 97 | 92 | 52 | 90 |
| N.S. | 1 | 1.00 | 0.85 | 1.14 | 1.46 | 1.54 | 1.31 | 1.24 | 0.70 | 1.22 |
| time (sec) |
N/A | 0.016 | 0.053 | 0.135 | 0.354 | 0.322 | 2.015 | 0.006 | 0.150 | 3.988 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 44 | 44 | 47 | 62 | 70 | 93 | 42 | 89 | 41 | 34 |
| N.S. | 1 | 1.00 | 1.07 | 1.41 | 1.59 | 2.11 | 0.95 | 2.02 | 0.93 | 0.77 |
| time (sec) |
N/A | 0.012 | 0.045 | 0.120 | 0.361 | 0.311 | 0.937 | 10.401 | 0.683 | 2.625 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 47 | 61 | 54 | 89 | 68 | 96 | -1 | 71 |
| N.S. | 1 | 1.00 | 1.04 | 1.36 | 1.20 | 1.98 | 1.51 | 2.13 | -0.02 | 1.58 |
| time (sec) |
N/A | 0.012 | 0.055 | 0.106 | 0.362 | 0.312 | 0.780 | 10.385 | 0.000 | 2.647 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 21 | 49 | 15 | 15 | 41 | 78 | 21 | 33 |
| N.S. | 1 | 1.00 | 1.00 | 2.33 | 0.71 | 0.71 | 1.95 | 3.71 | 1.00 | 1.57 |
| time (sec) |
N/A | 0.001 | 0.018 | 0.119 | 0.282 | 0.324 | 0.793 | 0.007 | 0.237 | 2.543 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 44 | 44 | 39 | 71 | 31 | 34 | 65 | 113 | 32 | 44 |
| N.S. | 1 | 1.00 | 0.89 | 1.61 | 0.70 | 0.77 | 1.48 | 2.57 | 0.73 | 1.00 |
| time (sec) |
N/A | 0.004 | 0.064 | 0.100 | 0.260 | 0.310 | 2.944 | 0.009 | 0.255 | 4.400 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 51 | 93 | 46 | 45 | 347 | 149 | 43 | 95 |
| N.S. | 1 | 1.00 | 0.75 | 1.37 | 0.68 | 0.66 | 5.10 | 2.19 | 0.63 | 1.40 |
| time (sec) |
N/A | 0.007 | 0.069 | 0.113 | 0.263 | 0.305 | 9.619 | 0.010 | 0.264 | 11.732 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 127 | 127 | 92 | 135 | 170 | 164 | 323 | 158 | -1 | 286 |
| N.S. | 1 | 1.00 | 0.72 | 1.06 | 1.34 | 1.29 | 2.54 | 1.24 | -0.01 | 2.25 |
| time (sec) |
N/A | 0.030 | 0.132 | 0.127 | 0.405 | 0.312 | 21.131 | 0.007 | 0.000 | 22.584 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 102 | 102 | 81 | 112 | 135 | 142 | 260 | 130 | -1 | 252 |
| N.S. | 1 | 1.00 | 0.79 | 1.10 | 1.32 | 1.39 | 2.55 | 1.27 | -0.01 | 2.47 |
| time (sec) |
N/A | 0.022 | 0.110 | 0.128 | 0.361 | 0.313 | 5.338 | 0.007 | 0.000 | 12.847 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 77 | 77 | 71 | 89 | 95 | 118 | 207 | 98 | 58 | 192 |
| N.S. | 1 | 1.00 | 0.92 | 1.16 | 1.23 | 1.53 | 2.69 | 1.27 | 0.75 | 2.49 |
| time (sec) |
N/A | 0.017 | 0.082 | 0.110 | 0.410 | 0.315 | 2.010 | 0.007 | 0.083 | 4.212 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 46 | 46 | 53 | 66 | 52 | 94 | 119 | 94 | 43 | 130 |
| N.S. | 1 | 1.00 | 1.15 | 1.43 | 1.13 | 2.04 | 2.59 | 2.04 | 0.93 | 2.83 |
| time (sec) |
N/A | 0.012 | 0.055 | 0.119 | 0.381 | 0.317 | 0.956 | 10.598 | 0.593 | 2.953 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 53 | 66 | 35 | 91 | 148 | 102 | -1 | 145 |
| N.S. | 1 | 1.00 | 1.13 | 1.40 | 0.74 | 1.94 | 3.15 | 2.17 | -0.02 | 3.09 |
| time (sec) |
N/A | 0.012 | 0.062 | 0.127 | 0.356 | 0.329 | 0.832 | 10.301 | 0.000 | 2.846 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 22 | 52 | 16 | 23 | 88 | 83 | 21 | 90 |
| N.S. | 1 | 1.00 | 1.00 | 2.36 | 0.73 | 1.05 | 4.00 | 3.77 | 0.95 | 4.09 |
| time (sec) |
N/A | 0.001 | 0.060 | 0.111 | 0.294 | 0.298 | 0.821 | 0.008 | 0.243 | 2.649 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 46 | 46 | 41 | 75 | 33 | 34 | 241 | 120 | 32 | 229 |
| N.S. | 1 | 1.00 | 0.89 | 1.63 | 0.72 | 0.74 | 5.24 | 2.61 | 0.70 | 4.98 |
| time (sec) |
N/A | 0.004 | 0.072 | 0.123 | 0.284 | 0.306 | 2.995 | 0.010 | 0.253 | 4.532 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 71 | 71 | 52 | 98 | 49 | 46 | 707 | 158 | 43 | 461 |
| N.S. | 1 | 1.00 | 0.73 | 1.38 | 0.69 | 0.65 | 9.96 | 2.23 | 0.61 | 6.49 |
| time (sec) |
N/A | 0.008 | 0.078 | 0.102 | 0.281 | 0.312 | 11.983 | 0.011 | 0.269 | 45.141 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 108 | 108 | 76 | 121 | 163 | 140 | 117 | 140 | -1 | 88 |
| N.S. | 1 | 1.00 | 0.70 | 1.12 | 1.51 | 1.30 | 1.08 | 1.30 | -0.01 | 0.81 |
| time (sec) |
N/A | 0.024 | 0.083 | 0.142 | 0.371 | 0.335 | 20.552 | 0.005 | 0.000 | 21.048 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 65 | 100 | 134 | 121 | 90 | 116 | -1 | 81 |
| N.S. | 1 | 1.00 | 0.77 | 1.19 | 1.60 | 1.44 | 1.07 | 1.38 | -0.01 | 0.96 |
| time (sec) |
N/A | 0.015 | 0.071 | 0.104 | 0.353 | 0.319 | 4.859 | 0.005 | 0.000 | 6.588 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 56 | 79 | 98 | 101 | 71 | 86 | 46 | 66 |
| N.S. | 1 | 1.00 | 0.88 | 1.23 | 1.53 | 1.58 | 1.11 | 1.34 | 0.72 | 1.03 |
| time (sec) |
N/A | 0.011 | 0.053 | 0.112 | 0.360 | 0.317 | 1.790 | 0.004 | 0.098 | 3.572 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 40 | 40 | 46 | 58 | 68 | 86 | 37 | 86 | 40 | 29 |
| N.S. | 1 | 1.00 | 1.15 | 1.45 | 1.70 | 2.15 | 0.92 | 2.15 | 1.00 | 0.72 |
| time (sec) |
N/A | 0.005 | 0.043 | 0.126 | 0.345 | 0.313 | 0.842 | 1.141 | 0.617 | 2.527 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 47 | 49 | 54 | 87 | 48 | 96 | -1 | 50 |
| N.S. | 1 | 1.00 | 1.15 | 1.20 | 1.32 | 2.12 | 1.17 | 2.34 | -0.02 | 1.22 |
| time (sec) |
N/A | 0.007 | 0.048 | 0.125 | 0.337 | 0.317 | 0.728 | 1.152 | 0.000 | 2.626 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 18 | 18 | 18 | 27 | 12 | 12 | 37 | 75 | 18 | 28 |
| N.S. | 1 | 1.00 | 1.00 | 1.50 | 0.67 | 0.67 | 2.06 | 4.17 | 1.00 | 1.56 |
| time (sec) |
N/A | 0.001 | 0.019 | 0.119 | 0.277 | 0.311 | 0.774 | 0.008 | 0.208 | 2.530 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 31 | 43 | 26 | 25 | 56 | 102 | 26 | 35 |
| N.S. | 1 | 1.00 | 0.82 | 1.13 | 0.68 | 0.66 | 1.47 | 2.68 | 0.68 | 0.92 |
| time (sec) |
N/A | 0.003 | 0.050 | 0.122 | 0.268 | 0.308 | 2.883 | 0.009 | 0.215 | 4.348 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 59 | 59 | 40 | 59 | 41 | 34 | 270 | 130 | 34 | 75 |
| N.S. | 1 | 1.00 | 0.68 | 1.00 | 0.69 | 0.58 | 4.58 | 2.20 | 0.58 | 1.27 |
| time (sec) |
N/A | 0.006 | 0.056 | 0.129 | 0.257 | 0.305 | 9.443 | 0.009 | 0.224 | 11.364 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 112 | 112 | 82 | 128 | 147 | 141 | 250 | 147 | -1 | 190 |
| N.S. | 1 | 1.00 | 0.73 | 1.14 | 1.31 | 1.26 | 2.23 | 1.31 | -0.01 | 1.70 |
| time (sec) |
N/A | 0.021 | 0.115 | 0.122 | 0.345 | 0.320 | 20.523 | 0.006 | 0.000 | 21.262 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 87 | 87 | 72 | 106 | 117 | 125 | 194 | 121 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.83 | 1.22 | 1.34 | 1.44 | 2.23 | 1.39 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 0.092 | 0.123 | 0.347 | 0.320 | 4.949 | 0.005 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 62 | 85 | 81 | 107 | 155 | 92 | 53 | 0 |
| N.S. |
1 | 1.00 | 0.95 | 1.31 | 1.25 | 1.65 | 2.38 | 1.42 | 0.82 | 0.00 |
| time (sec) |
N/A | 0.011 | 0.066 | 0.125 | 0.361 | 0.314 | 1.792 | 0.005 | 0.104 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 52 | 63 | 49 | 89 | 119 | 91 | 42 | 100 |
| N.S. | 1 | 1.00 | 1.27 | 1.54 | 1.20 | 2.17 | 2.90 | 2.22 | 1.02 | 2.44 |
| time (sec) |
N/A | 0.006 | 0.049 | 0.109 | 0.360 | 0.313 | 0.860 | 1.138 | 0.562 | 2.653 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | A | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 42 | 42 | 53 | 64 | 35 | 90 | 122 | 102 | -1 | 111 |
| N.S. | 1 | 1.00 | 1.26 | 1.52 | 0.83 | 2.14 | 2.90 | 2.43 | -0.02 | 2.64 |
| time (sec) |
N/A | 0.007 | 0.054 | 0.110 | 0.340 | 0.312 | 0.776 | 1.136 | 0.000 | 2.934 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 19 | 29 | 13 | 18 | 83 | 80 | 18 | 77 |
| N.S. | 1 | 1.00 | 1.00 | 1.53 | 0.68 | 0.95 | 4.37 | 4.21 | 0.95 | 4.05 |
| time (sec) |
N/A | 0.001 | 0.050 | 0.141 | 0.275 | 0.316 | 0.805 | 0.008 | 0.224 | 2.592 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 40 | 40 | 31 | 46 | 28 | 25 | 194 | 109 | 26 | 117 |
| N.S. | 1 | 1.00 | 0.78 | 1.15 | 0.70 | 0.62 | 4.85 | 2.72 | 0.65 | 2.92 |
| time (sec) |
N/A | 0.003 | 0.058 | 0.111 | 0.265 | 0.309 | 2.954 | 0.009 | 0.219 | 5.054 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 62 | 62 | 41 | 63 | 44 | 35 | 556 | 139 | 34 | 363 |
| N.S. | 1 | 1.00 | 0.66 | 1.02 | 0.71 | 0.56 | 8.97 | 2.24 | 0.55 | 5.85 |
| time (sec) |
N/A | 0.007 | 0.064 | 0.133 | 0.275 | 0.302 | 11.453 | 0.010 | 0.224 | 11.215 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 143 | 143 | 99 | 144 | 212 | 184 | 178 | 334 | -1 | 143 |
| N.S. | 1 | 1.00 | 0.69 | 1.01 | 1.48 | 1.29 | 1.24 | 2.34 | -0.01 | 1.00 |
| time (sec) |
N/A | 0.035 | 0.111 | 0.122 | 0.341 | 0.323 | 59.829 | 0.013 | 0.000 | 59.124 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 119 | 119 | 88 | 122 | 178 | 163 | 153 | 279 | -1 | 133 |
| N.S. | 1 | 1.00 | 0.74 | 1.03 | 1.50 | 1.37 | 1.29 | 2.34 | -0.01 | 1.12 |
| time (sec) |
N/A | 0.027 | 0.083 | 0.105 | 0.354 | 0.328 | 12.472 | 0.014 | 0.000 | 13.845 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 95 | 95 | 76 | 97 | 144 | 140 | 124 | 378 | -1 | 98 |
| N.S. | 1 | 1.00 | 0.80 | 1.02 | 1.52 | 1.47 | 1.31 | 3.98 | -0.01 | 1.03 |
| time (sec) |
N/A | 0.020 | 0.088 | 0.106 | 0.357 | 0.316 | 3.911 | 30.711 | 0.000 | 5.834 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 71 | 71 | 62 | 78 | 107 | 119 | 75 | 120 | -1 | 51 |
| N.S. | 1 | 1.00 | 0.87 | 1.10 | 1.51 | 1.68 | 1.06 | 1.69 | -0.01 | 0.72 |
| time (sec) |
N/A | 0.016 | 0.072 | 0.123 | 0.331 | 0.325 | 1.728 | 10.362 | 0.000 | 3.514 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 63 | 63 | 54 | 71 | 84 | 109 | 92 | 126 | -1 | 84 |
| N.S. | 1 | 1.00 | 0.86 | 1.13 | 1.33 | 1.73 | 1.46 | 2.00 | -0.02 | 1.33 |
| time (sec) |
N/A | 0.015 | 0.096 | 0.102 | 0.335 | 0.323 | 1.518 | 10.284 | 0.000 | 3.439 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 55 | 67 | 67 | 109 | 71 | 143 | -1 | 76 |
| N.S. | 1 | 1.00 | 0.86 | 1.05 | 1.05 | 1.70 | 1.11 | 2.23 | -0.02 | 1.19 |
| time (sec) |
N/A | 0.015 | 0.096 | 0.106 | 0.373 | 0.311 | 1.778 | 10.355 | 0.000 | 3.705 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 149 | 149 | 104 | 152 | 207 | 185 | 376 | 348 | -1 | 316 |
| N.S. | 1 | 1.00 | 0.70 | 1.02 | 1.39 | 1.24 | 2.52 | 2.34 | -0.01 | 2.12 |
| time (sec) |
N/A | 0.036 | 0.158 | 0.109 | 0.360 | 0.338 | 59.652 | 0.014 | 0.000 | 57.978 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 124 | 124 | 93 | 129 | 170 | 163 | 323 | 292 | -1 | 282 |
| N.S. | 1 | 1.00 | 0.75 | 1.04 | 1.37 | 1.31 | 2.60 | 2.35 | -0.01 | 2.27 |
| time (sec) |
N/A | 0.027 | 0.125 | 0.108 | 0.341 | 0.319 | 12.226 | 0.013 | 0.000 | 24.029 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 99 | 99 | 82 | 104 | 133 | 141 | 264 | 406 | -1 | 222 |
| N.S. | 1 | 1.00 | 0.83 | 1.05 | 1.34 | 1.42 | 2.67 | 4.10 | -0.01 | 2.24 |
| time (sec) |
N/A | 0.021 | 0.110 | 0.107 | 0.346 | 0.327 | 3.998 | 31.182 | 0.000 | 6.069 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 68 | 83 | 93 | 119 | 190 | 127 | -1 | 162 |
| N.S. | 1 | 1.00 | 0.92 | 1.12 | 1.26 | 1.61 | 2.57 | 1.72 | -0.01 | 2.19 |
| time (sec) |
N/A | 0.016 | 0.089 | 0.105 | 0.341 | 0.328 | 1.780 | 10.343 | 0.000 | 3.824 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 61 | 74 | 68 | 109 | 197 | 135 | -1 | 183 |
| N.S. | 1 | 1.00 | 0.92 | 1.12 | 1.03 | 1.65 | 2.98 | 2.05 | -0.02 | 2.77 |
| time (sec) |
N/A | 0.016 | 0.097 | 0.104 | 0.345 | 0.309 | 1.584 | 10.381 | 0.000 | 3.642 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 64 | 71 | 49 | 115 | 187 | 151 | -1 | 175 |
| N.S. | 1 | 1.00 | 0.96 | 1.06 | 0.73 | 1.72 | 2.79 | 2.25 | -0.01 | 2.61 |
| time (sec) |
N/A | 0.015 | 0.105 | 0.105 | 0.344 | 0.320 | 1.923 | 10.430 | 0.000 | 3.926 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 126 | 126 | 84 | 135 | 194 | 156 | 136 | 308 | -1 | 103 |
| N.S. | 1 | 1.00 | 0.67 | 1.07 | 1.54 | 1.24 | 1.08 | 2.44 | -0.01 | 0.82 |
| time (sec) |
N/A | 0.025 | 0.106 | 0.115 | 0.359 | 0.321 | 58.731 | 0.010 | 0.000 | 56.680 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 105 | 105 | 75 | 114 | 163 | 137 | 117 | 258 | -1 | 89 |
| N.S. | 1 | 1.00 | 0.71 | 1.09 | 1.55 | 1.30 | 1.11 | 2.46 | -0.01 | 0.85 |
| time (sec) |
N/A | 0.018 | 0.076 | 0.111 | 0.340 | 0.311 | 11.517 | 0.009 | 0.000 | 12.886 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 65 | 87 | 132 | 124 | 92 | 361 | -1 | 75 |
| N.S. | 1 | 1.00 | 0.79 | 1.06 | 1.61 | 1.51 | 1.12 | 4.40 | -0.01 | 0.91 |
| time (sec) |
N/A | 0.011 | 0.074 | 0.122 | 0.343 | 0.318 | 3.522 | 3.500 | 0.000 | 5.228 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 54 | 72 | 98 | 105 | 76 | 113 | -1 | 54 |
| N.S. | 1 | 1.00 | 0.89 | 1.18 | 1.61 | 1.72 | 1.25 | 1.85 | -0.02 | 0.89 |
| time (sec) |
N/A | 0.008 | 0.064 | 0.116 | 0.347 | 0.326 | 1.587 | 1.174 | 0.000 | 3.322 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 51 | 55 | 81 | 99 | 73 | 118 | -1 | 61 |
| N.S. | 1 | 1.00 | 0.88 | 0.95 | 1.40 | 1.71 | 1.26 | 2.03 | -0.02 | 1.05 |
| time (sec) |
N/A | 0.009 | 0.073 | 0.125 | 0.334 | 0.314 | 1.388 | 1.125 | 0.000 | 3.176 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 60 | 60 | 55 | 55 | 67 | 108 | 70 | 133 | -1 | 74 |
| N.S. | 1 | 1.00 | 0.92 | 0.92 | 1.12 | 1.80 | 1.17 | 2.22 | -0.02 | 1.23 |
| time (sec) |
N/A | 0.010 | 0.083 | 0.129 | 0.358 | 0.336 | 1.666 | 1.128 | 0.000 | 3.581 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 131 | 131 | 90 | 143 | 179 | 157 | 289 | 322 | -1 | 229 |
| N.S. | 1 | 1.00 | 0.69 | 1.09 | 1.37 | 1.20 | 2.21 | 2.46 | -0.01 | 1.75 |
| time (sec) |
N/A | 0.026 | 0.130 | 0.113 | 0.340 | 0.324 | 58.581 | 0.011 | 0.000 | 57.768 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 109 | 109 | 81 | 122 | 147 | 139 | 250 | 271 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.74 | 1.12 | 1.35 | 1.28 | 2.29 | 2.49 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.020 | 0.104 | 0.109 | 0.349 | 0.318 | 11.510 | 0.011 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 71 | 94 | 115 | 125 | 197 | 389 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.85 | 1.12 | 1.37 | 1.49 | 2.35 | 4.63 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.011 | 0.091 | 0.110 | 0.342 | 0.323 | 3.577 | 3.376 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 63 | 63 | 60 | 78 | 79 | 107 | 165 | 120 | -1 | 125 |
| N.S. | 1 | 1.00 | 0.95 | 1.24 | 1.25 | 1.70 | 2.62 | 1.90 | -0.02 | 1.98 |
| time (sec) |
N/A | 0.009 | 0.074 | 0.112 | 0.344 | 0.319 | 1.588 | 1.122 | 0.000 | 3.407 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 60 | 60 | 58 | 70 | 63 | 101 | 158 | 128 | -1 | 132 |
| N.S. | 1 | 1.00 | 0.97 | 1.17 | 1.05 | 1.68 | 2.63 | 2.13 | -0.02 | 2.20 |
| time (sec) |
N/A | 0.009 | 0.083 | 0.125 | 0.368 | 0.319 | 1.453 | 1.160 | 0.000 | 3.831 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 62 | 62 | 62 | 70 | 49 | 111 | 184 | 141 | -1 | 163 |
| N.S. | 1 | 1.00 | 1.00 | 1.13 | 0.79 | 1.79 | 2.97 | 2.27 | -0.02 | 2.63 |
| time (sec) |
N/A | 0.010 | 0.088 | 0.125 | 0.346 | 0.317 | 1.806 | 1.134 | 0.000 | 3.709 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 164 | 164 | 110 | 160 | 244 | 206 | 207 | 546 | -1 | 154 |
| N.S. | 1 | 1.00 | 0.67 | 0.98 | 1.49 | 1.26 | 1.26 | 3.33 | -0.01 | 0.94 |
| time (sec) |
N/A | 0.044 | 0.106 | 0.105 | 0.365 | 0.317 | 179.382 | 0.022 | 0.000 | 174.242 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 140 | 140 | 99 | 138 | 212 | 185 | 180 | 465 | -1 | 144 |
| N.S. | 1 | 1.00 | 0.71 | 0.99 | 1.51 | 1.32 | 1.29 | 3.32 | -0.01 | 1.03 |
| time (sec) |
N/A | 0.033 | 0.118 | 0.119 | 0.388 | 0.317 | 33.750 | 0.019 | 0.000 | 34.078 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 116 | 116 | 87 | 113 | 176 | 162 | 155 | 589 | -1 | 109 |
| N.S. | 1 | 1.00 | 0.75 | 0.97 | 1.52 | 1.40 | 1.34 | 5.08 | -0.01 | 0.94 |
| time (sec) |
N/A | 0.025 | 0.112 | 0.121 | 0.340 | 0.338 | 8.982 | 41.109 | 0.000 | 10.592 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 73 | 94 | 141 | 141 | 102 | 150 | -1 | 62 |
| N.S. | 1 | 1.00 | 0.79 | 1.02 | 1.53 | 1.53 | 1.11 | 1.63 | -0.01 | 0.67 |
| time (sec) |
N/A | 0.019 | 0.091 | 0.104 | 0.340 | 0.322 | 4.040 | 10.430 | 0.000 | 5.632 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 89 | 89 | 73 | 84 | 125 | 137 | 126 | 155 | -1 | 91 |
| N.S. | 1 | 1.00 | 0.82 | 0.94 | 1.40 | 1.54 | 1.42 | 1.74 | -0.01 | 1.02 |
| time (sec) |
N/A | 0.019 | 0.107 | 0.104 | 0.353 | 0.315 | 3.952 | 10.496 | 0.000 | 5.687 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 86 | 86 | 69 | 82 | 100 | 138 | 99 | 185 | -1 | 99 |
| N.S. | 1 | 1.00 | 0.80 | 0.95 | 1.16 | 1.60 | 1.15 | 2.15 | -0.01 | 1.15 |
| time (sec) |
N/A | 0.019 | 0.121 | 0.109 | 0.337 | 0.317 | 3.746 | 10.495 | 0.000 | 5.521 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 171 | 171 | 114 | 169 | 242 | 208 | 435 | 568 | -1 | 349 |
| N.S. | 1 | 1.00 | 0.67 | 0.99 | 1.42 | 1.22 | 2.54 | 3.32 | -0.01 | 2.04 |
| time (sec) |
N/A | 0.042 | 0.169 | 0.112 | 0.365 | 0.315 | 177.746 | 0.025 | 0.000 | 173.365 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 146 | 146 | 103 | 146 | 207 | 186 | 379 | 484 | -1 | 315 |
| N.S. | 1 | 1.00 | 0.71 | 1.00 | 1.42 | 1.27 | 2.60 | 3.32 | -0.01 | 2.16 |
| time (sec) |
N/A | 0.034 | 0.157 | 0.141 | 0.360 | 0.338 | 33.664 | 0.022 | 0.000 | 49.673 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 121 | 121 | 93 | 121 | 168 | 164 | 326 | 629 | -1 | 256 |
| N.S. | 1 | 1.00 | 0.77 | 1.00 | 1.39 | 1.36 | 2.69 | 5.20 | -0.01 | 2.12 |
| time (sec) |
N/A | 0.026 | 0.137 | 0.107 | 0.376 | 0.321 | 8.944 | 41.911 | 0.000 | 10.807 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 96 | 96 | 79 | 100 | 130 | 142 | 246 | 159 | -1 | 195 |
| N.S. | 1 | 1.00 | 0.82 | 1.04 | 1.35 | 1.48 | 2.56 | 1.66 | -0.01 | 2.03 |
| time (sec) |
N/A | 0.020 | 0.112 | 0.104 | 0.363 | 0.307 | 4.026 | 10.418 | 0.000 | 5.992 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 93 | 93 | 79 | 88 | 112 | 137 | 267 | 167 | -1 | 216 |
| N.S. | 1 | 1.00 | 0.85 | 0.95 | 1.20 | 1.47 | 2.87 | 1.80 | -0.01 | 2.32 |
| time (sec) |
N/A | 0.020 | 0.123 | 0.124 | 0.347 | 0.310 | 3.977 | 10.449 | 0.000 | 5.855 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 90 | 90 | 76 | 86 | 84 | 139 | 245 | 195 | -1 | 224 |
| N.S. | 1 | 1.00 | 0.84 | 0.96 | 0.93 | 1.54 | 2.72 | 2.17 | -0.01 | 2.49 |
| time (sec) |
N/A | 0.019 | 0.135 | 0.120 | 0.365 | 0.316 | 3.826 | 10.488 | 0.000 | 5.730 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 144 | 144 | 92 | 147 | 223 | 172 | 158 | 500 | -1 | 119 |
| N.S. | 1 | 1.00 | 0.64 | 1.02 | 1.55 | 1.19 | 1.10 | 3.47 | -0.01 | 0.83 |
| time (sec) |
N/A | 0.032 | 0.103 | 0.112 | 0.348 | 0.313 | 176.877 | 0.017 | 0.000 | 171.191 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 123 | 123 | 84 | 126 | 194 | 155 | 138 | 427 | -1 | 97 |
| N.S. | 1 | 1.00 | 0.68 | 1.02 | 1.58 | 1.26 | 1.12 | 3.47 | -0.01 | 0.79 |
| time (sec) |
N/A | 0.020 | 0.108 | 0.110 | 0.348 | 0.311 | 32.986 | 0.015 | 0.000 | 32.895 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 102 | 102 | 76 | 99 | 161 | 140 | 119 | 559 | -1 | 84 |
| N.S. | 1 | 1.00 | 0.75 | 0.97 | 1.58 | 1.37 | 1.17 | 5.48 | -0.01 | 0.82 |
| time (sec) |
N/A | 0.015 | 0.091 | 0.108 | 0.377 | 0.313 | 8.461 | 4.594 | 0.000 | 9.944 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 79 | 79 | 63 | 84 | 129 | 123 | 97 | 141 | -1 | 63 |
| N.S. | 1 | 1.00 | 0.80 | 1.06 | 1.63 | 1.56 | 1.23 | 1.78 | -0.01 | 0.80 |
| time (sec) |
N/A | 0.012 | 0.077 | 0.112 | 0.352 | 0.326 | 3.733 | 1.147 | 0.000 | 5.303 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 79 | 79 | 62 | 63 | 113 | 116 | 94 | 145 | -1 | 70 |
| N.S. | 1 | 1.00 | 0.78 | 0.80 | 1.43 | 1.47 | 1.19 | 1.84 | -0.01 | 0.89 |
| time (sec) |
N/A | 0.012 | 0.087 | 0.109 | 0.351 | 0.319 | 3.753 | 1.221 | 0.000 | 5.258 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 63 | 63 | 96 | 123 | 88 | 169 | -1 | 92 |
| N.S. | 1 | 1.00 | 0.78 | 0.78 | 1.19 | 1.52 | 1.09 | 2.09 | -0.01 | 1.14 |
| time (sec) |
N/A | 0.013 | 0.097 | 0.139 | 0.347 | 0.316 | 3.476 | 1.234 | 0.000 | 5.286 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-1) | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 150 | 150 | 98 | 157 | 209 | 173 | 0 | 522 | -1 | 253 |
| N.S. |
1 | 1.00 | 0.65 | 1.05 | 1.39 | 1.15 | 0.00 | 3.48 | -0.01 | 1.69 |
| time (sec) |
N/A | 0.033 | 0.139 | 0.133 | 0.366 | 0.325 | 0.000 | 0.017 | 0.000 | 170.176 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 128 | 128 | 90 | 135 | 179 | 157 | 292 | 446 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.05 | 1.40 | 1.23 | 2.28 | 3.48 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.129 | 0.125 | 0.345 | 0.328 | 32.953 | 0.017 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 106 | 106 | 82 | 107 | 145 | 141 | 253 | 599 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.77 | 1.01 | 1.37 | 1.33 | 2.39 | 5.65 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 0.109 | 0.130 | 0.366 | 0.320 | 8.216 | 4.780 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 69 | 91 | 112 | 125 | 207 | 150 | -1 | 149 |
| N.S. | 1 | 1.00 | 0.84 | 1.11 | 1.37 | 1.52 | 2.52 | 1.83 | -0.01 | 1.82 |
| time (sec) |
N/A | 0.013 | 0.094 | 0.139 | 0.356 | 0.317 | 3.687 | 1.222 | 0.000 | 5.395 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 68 | 78 | 96 | 117 | 201 | 157 | -1 | 156 |
| N.S. | 1 | 1.00 | 0.83 | 0.95 | 1.17 | 1.43 | 2.45 | 1.91 | -0.01 | 1.90 |
| time (sec) |
N/A | 0.012 | 0.099 | 0.120 | 0.371 | 0.325 | 3.686 | 1.260 | 0.000 | 6.991 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 70 | 78 | 79 | 126 | 223 | 179 | -1 | 200 |
| N.S. | 1 | 1.00 | 0.83 | 0.93 | 0.94 | 1.50 | 2.65 | 2.13 | -0.01 | 2.38 |
| time (sec) |
N/A | 0.013 | 0.108 | 0.148 | 0.357 | 0.311 | 3.623 | 1.192 | 0.000 | 5.462 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 76 | 109 | 146 | 140 | 128 | 124 | -1 | 125 |
| N.S. | 1 | 1.00 | 0.75 | 1.08 | 1.45 | 1.39 | 1.27 | 1.23 | -0.01 | 1.24 |
| time (sec) |
N/A | 0.020 | 0.085 | 0.124 | 0.368 | 0.311 | 9.518 | 0.006 | 0.000 | 10.636 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 77 | 77 | 66 | 87 | 112 | 119 | 100 | 96 | -1 | 93 |
| N.S. | 1 | 1.00 | 0.86 | 1.13 | 1.45 | 1.55 | 1.30 | 1.25 | -0.01 | 1.21 |
| time (sec) |
N/A | 0.016 | 0.066 | 0.104 | 0.341 | 0.322 | 2.811 | 0.005 | 0.000 | 4.645 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 49 | 65 | 73 | 91 | 44 | 61 | 44 | 38 |
| N.S. | 1 | 1.00 | 1.02 | 1.35 | 1.52 | 1.90 | 0.92 | 1.27 | 0.92 | 0.79 |
| time (sec) |
N/A | 0.012 | 0.050 | 0.107 | 0.340 | 0.319 | 1.161 | 0.007 | 0.548 | 2.844 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 30 | 48 | 41 | 57 | 22 | 33 | 30 | 16 |
| N.S. | 1 | 1.00 | 1.07 | 1.71 | 1.46 | 2.04 | 0.79 | 1.18 | 1.07 | 0.57 |
| time (sec) |
N/A | 0.010 | 0.029 | 0.115 | 0.357 | 0.314 | 0.511 | 0.003 | 0.030 | 2.009 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 19 | 16 | 15 | 15 | 19 | 37 | 15 | 20 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.79 | 0.79 | 1.00 | 1.95 | 0.79 | 1.05 |
| time (sec) |
N/A | 0.001 | 0.016 | 0.120 | 0.249 | 0.305 | 0.484 | 0.004 | 0.349 | 1.999 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 44 | 44 | 27 | 33 | 31 | 23 | 42 | 72 | 25 | 33 |
| N.S. | 1 | 1.00 | 0.61 | 0.75 | 0.70 | 0.52 | 0.95 | 1.64 | 0.57 | 0.75 |
| time (sec) |
N/A | 0.004 | 0.052 | 0.119 | 0.250 | 0.306 | 1.142 | 0.005 | 0.342 | 2.787 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 40 | 55 | 46 | 34 | 287 | 102 | 36 | 84 |
| N.S. | 1 | 1.00 | 0.59 | 0.81 | 0.68 | 0.50 | 4.22 | 1.50 | 0.53 | 1.24 |
| time (sec) |
N/A | 0.007 | 0.063 | 0.117 | 0.250 | 0.309 | 4.085 | 0.007 | 0.353 | 6.956 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 51 | 77 | 61 | 45 | 488 | 131 | 47 | 117 |
| N.S. | 1 | 1.00 | 0.55 | 0.84 | 0.66 | 0.49 | 5.30 | 1.42 | 0.51 | 1.27 |
| time (sec) |
N/A | 0.012 | 0.070 | 0.125 | 0.313 | 0.299 | 12.384 | 0.009 | 0.382 | 14.508 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 96 | 96 | 76 | 119 | 131 | 175 | 105 | 132 | -1 | 93 |
| N.S. | 1 | 1.00 | 0.79 | 1.24 | 1.36 | 1.82 | 1.09 | 1.38 | -0.01 | 0.97 |
| time (sec) |
N/A | 0.022 | 0.107 | 0.129 | 0.351 | 0.318 | 5.743 | 0.008 | 0.000 | 7.152 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 57 | 106 | 92 | 145 | 71 | 97 | -1 | 77 |
| N.S. | 1 | 1.00 | 0.84 | 1.56 | 1.35 | 2.13 | 1.04 | 1.43 | -0.01 | 1.13 |
| time (sec) |
N/A | 0.015 | 0.097 | 0.128 | 0.338 | 0.339 | 1.986 | 0.008 | 0.000 | 3.741 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 50 | 0 | 57 | 119 | 46 | 65 | -1 | 38 |
| N.S. | 1 | 1.00 | 1.04 | 0.00 | 1.19 | 2.48 | 0.96 | 1.35 | -0.02 | 0.79 |
| time (sec) |
N/A | 0.013 | 0.064 | 0.028 | 0.333 | 0.318 | 0.862 | 0.008 | 0.000 | 2.580 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 19 | 16 | 15 | 22 | 17 | 53 | 22 | 20 |
| N.S. | 1 | 1.00 | 1.00 | 0.84 | 0.79 | 1.16 | 0.89 | 2.79 | 1.16 | 1.05 |
| time (sec) |
N/A | 0.001 | 0.017 | 0.117 | 0.265 | 0.312 | 0.467 | 0.005 | 0.326 | 1.981 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 39 | 39 | 25 | 33 | 32 | 34 | 41 | 73 | 39 | 37 |
| N.S. | 1 | 1.00 | 0.64 | 0.85 | 0.82 | 0.87 | 1.05 | 1.87 | 1.00 | 0.95 |
| time (sec) |
N/A | 0.004 | 0.056 | 0.144 | 0.258 | 0.305 | 0.882 | 0.005 | 0.386 | 2.621 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 63 | 63 | 38 | 55 | 50 | 49 | 219 | 152 | 46 | 73 |
| N.S. | 1 | 1.00 | 0.60 | 0.87 | 0.79 | 0.78 | 3.48 | 2.41 | 0.73 | 1.16 |
| time (sec) |
N/A | 0.007 | 0.076 | 0.128 | 0.251 | 0.299 | 2.496 | 0.010 | 0.413 | 5.204 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 87 | 87 | 49 | 77 | 64 | 58 | 348 | 233 | 58 | 99 |
| N.S. | 1 | 1.00 | 0.56 | 0.89 | 0.74 | 0.67 | 4.00 | 2.68 | 0.67 | 1.14 |
| time (sec) |
N/A | 0.012 | 0.088 | 0.129 | 0.257 | 0.312 | 8.267 | 0.016 | 0.426 | 10.438 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | B | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 91 | 91 | 72 | 147 | 109 | 214 | 396 | 138 | -1 | 131 |
| N.S. | 1 | 1.00 | 0.79 | 1.62 | 1.20 | 2.35 | 4.35 | 1.52 | -0.01 | 1.44 |
| time (sec) |
N/A | 0.023 | 0.126 | 0.139 | 0.345 | 0.322 | 5.024 | 0.011 | 0.000 | 8.513 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | A | A | B | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 69 | 69 | 60 | 0 | 69 | 186 | 328 | 106 | -1 | 102 |
| N.S. | 1 | 1.00 | 0.87 | 0.00 | 1.00 | 2.70 | 4.75 | 1.54 | -0.01 | 1.48 |
| time (sec) |
N/A | 0.015 | 0.117 | 0.026 | 0.348 | 0.322 | 2.148 | 0.011 | 0.000 | 5.873 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 21 | 54 | 15 | 33 | 42 | 42 | 36 | 26 |
| N.S. | 1 | 1.00 | 1.00 | 2.57 | 0.71 | 1.57 | 2.00 | 2.00 | 1.71 | 1.24 |
| time (sec) |
N/A | 0.001 | 0.019 | 0.119 | 0.248 | 0.305 | 0.779 | 0.008 | 0.242 | 2.546 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 29 | 32 | 27 | 43 | 92 | 102 | 54 | 38 |
| N.S. | 1 | 1.00 | 0.67 | 0.74 | 0.63 | 1.00 | 2.14 | 2.37 | 1.26 | 0.88 |
| time (sec) |
N/A | 0.004 | 0.061 | 0.118 | 0.260 | 0.308 | 1.084 | 0.009 | 0.400 | 3.435 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 40 | 54 | 46 | 58 | 153 | 115 | 71 | 58 |
| N.S. | 1 | 1.00 | 0.62 | 0.84 | 0.72 | 0.91 | 2.39 | 1.80 | 1.11 | 0.91 |
| time (sec) |
N/A | 0.007 | 0.077 | 0.138 | 0.262 | 0.306 | 2.487 | 0.009 | 0.420 | 4.739 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 49 | 76 | 64 | 71 | 337 | 189 | 88 | 95 |
| N.S. | 1 | 1.00 | 0.58 | 0.90 | 0.76 | 0.85 | 4.01 | 2.25 | 1.05 | 1.13 |
| time (sec) |
N/A | 0.011 | 0.085 | 0.131 | 0.295 | 0.316 | 4.656 | 0.013 | 0.471 | 7.833 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 105 | 105 | 82 | 116 | 135 | 141 | 270 | 131 | -1 | 254 |
| N.S. | 1 | 1.00 | 0.78 | 1.10 | 1.29 | 1.34 | 2.57 | 1.25 | -0.01 | 2.42 |
| time (sec) |
N/A | 0.022 | 0.109 | 0.123 | 0.354 | 0.312 | 9.282 | 0.006 | 0.000 | 18.664 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 80 | 80 | 71 | 93 | 98 | 119 | 214 | 101 | -1 | 195 |
| N.S. | 1 | 1.00 | 0.89 | 1.16 | 1.22 | 1.49 | 2.68 | 1.26 | -0.01 | 2.44 |
| time (sec) |
N/A | 0.016 | 0.089 | 0.127 | 0.340 | 0.317 | 2.792 | 0.007 | 0.000 | 5.143 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 50 | 50 | 56 | 70 | 56 | 93 | 121 | 67 | 47 | 135 |
| N.S. | 1 | 1.00 | 1.12 | 1.40 | 1.12 | 1.86 | 2.42 | 1.34 | 0.94 | 2.70 |
| time (sec) |
N/A | 0.012 | 0.061 | 0.123 | 0.341 | 0.330 | 1.187 | 0.005 | 0.517 | 3.166 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 35 | 51 | 21 | 57 | 54 | 36 | 27 | 44 |
| N.S. | 1 | 1.00 | 1.21 | 1.76 | 0.72 | 1.97 | 1.86 | 1.24 | 0.93 | 1.52 |
| time (sec) |
N/A | 0.010 | 0.040 | 0.106 | 0.369 | 0.315 | 0.537 | 0.003 | 0.031 | 2.198 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 20 | 17 | 16 | 16 | 46 | 40 | 16 | 55 |
| N.S. | 1 | 1.00 | 1.00 | 0.85 | 0.80 | 0.80 | 2.30 | 2.00 | 0.80 | 2.75 |
| time (sec) |
N/A | 0.001 | 0.017 | 0.128 | 0.247 | 0.307 | 0.510 | 0.005 | 0.401 | 2.193 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 46 | 46 | 28 | 35 | 32 | 22 | 177 | 76 | 26 | 174 |
| N.S. | 1 | 1.00 | 0.61 | 0.76 | 0.70 | 0.48 | 3.85 | 1.65 | 0.57 | 3.78 |
| time (sec) |
N/A | 0.004 | 0.062 | 0.118 | 0.260 | 0.303 | 1.141 | 0.006 | 0.350 | 2.939 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 81 | 127 | 118 | 181 | 224 | 136 | -1 | 201 |
| N.S. | 1 | 1.00 | 0.81 | 1.27 | 1.18 | 1.81 | 2.24 | 1.36 | -0.01 | 2.01 |
| time (sec) |
N/A | 0.021 | 0.141 | 0.128 | 0.337 | 0.322 | 5.726 | 0.011 | 0.000 | 7.525 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 71 | 71 | 64 | 114 | 75 | 152 | 155 | 103 | -1 | 160 |
| N.S. | 1 | 1.00 | 0.90 | 1.61 | 1.06 | 2.14 | 2.18 | 1.45 | -0.01 | 2.25 |
| time (sec) |
N/A | 0.016 | 0.127 | 0.130 | 0.344 | 0.331 | 2.034 | 0.009 | 0.000 | 3.950 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 50 | 50 | 56 | 0 | 38 | 128 | 102 | 68 | -1 | 89 |
| N.S. | 1 | 1.00 | 1.12 | 0.00 | 0.76 | 2.56 | 2.04 | 1.36 | -0.02 | 1.78 |
| time (sec) |
N/A | 0.012 | 0.093 | 0.031 | 0.345 | 0.327 | 0.929 | 0.008 | 0.000 | 2.719 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 20 | 17 | 16 | 25 | 44 | 59 | 24 | 55 |
| N.S. | 1 | 1.00 | 1.00 | 0.85 | 0.80 | 1.25 | 2.20 | 2.95 | 1.20 | 2.75 |
| time (sec) |
N/A | 0.001 | 0.018 | 0.116 | 0.262 | 0.307 | 0.499 | 0.009 | 0.339 | 2.182 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 26 | 35 | 34 | 38 | 112 | 77 | 42 | 126 |
| N.S. | 1 | 1.00 | 0.63 | 0.85 | 0.83 | 0.93 | 2.73 | 1.88 | 1.02 | 3.07 |
| time (sec) |
N/A | 0.004 | 0.071 | 0.132 | 0.253 | 0.545 | 0.918 | 0.005 | 0.400 | 2.730 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 39 | 58 | 52 | 51 | 452 | 162 | 48 | 311 |
| N.S. | 1 | 1.00 | 0.59 | 0.88 | 0.79 | 0.77 | 6.85 | 2.45 | 0.73 | 4.71 |
| time (sec) |
N/A | 0.007 | 0.091 | 0.136 | 0.265 | 0.303 | 2.667 | 0.011 | 0.432 | 8.555 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 95 | 95 | 78 | 160 | 94 | 215 | 971 | 146 | -1 | 523 |
| N.S. | 1 | 1.00 | 0.82 | 1.68 | 0.99 | 2.26 | 10.22 | 1.54 | -0.01 | 5.51 |
| time (sec) |
N/A | 0.021 | 0.160 | 0.122 | 0.342 | 0.325 | 5.426 | 0.013 | 0.000 | 11.137 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | A | A | C | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 66 | 0 | 52 | 188 | 833 | 110 | -1 | 427 |
| N.S. | 1 | 1.00 | 0.92 | 0.00 | 0.72 | 2.61 | 11.57 | 1.53 | -0.01 | 5.93 |
| time (sec) |
N/A | 0.015 | 0.133 | 0.028 | 0.349 | 0.316 | 2.410 | 0.012 | 0.000 | 9.916 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 22 | 56 | 16 | 34 | 95 | 44 | 37 | 84 |
| N.S. | 1 | 1.00 | 1.00 | 2.55 | 0.73 | 1.55 | 4.32 | 2.00 | 1.68 | 3.82 |
| time (sec) |
N/A | 0.001 | 0.020 | 0.107 | 0.248 | 0.306 | 0.809 | 0.010 | 0.252 | 2.684 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 30 | 34 | 30 | 44 | 197 | 109 | 56 | 157 |
| N.S. | 1 | 1.00 | 0.67 | 0.76 | 0.67 | 0.98 | 4.38 | 2.42 | 1.24 | 3.49 |
| time (sec) |
N/A | 0.004 | 0.073 | 0.120 | 0.272 | 0.313 | 1.120 | 0.011 | 0.406 | 3.601 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 41 | 57 | 50 | 59 | 314 | 119 | 73 | 229 |
| N.S. | 1 | 1.00 | 0.61 | 0.85 | 0.75 | 0.88 | 4.69 | 1.78 | 1.09 | 3.42 |
| time (sec) |
N/A | 0.007 | 0.090 | 0.155 | 0.258 | 0.318 | 2.563 | 0.008 | 0.441 | 5.418 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 88 | 88 | 50 | 80 | 68 | 70 | 688 | 200 | 92 | 447 |
| N.S. | 1 | 1.00 | 0.57 | 0.91 | 0.77 | 0.80 | 7.82 | 2.27 | 1.05 | 5.08 |
| time (sec) |
N/A | 0.012 | 0.105 | 0.135 | 0.268 | 0.315 | 5.982 | 0.014 | 0.475 | 59.408 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 88 | 88 | 66 | 104 | 134 | 124 | 95 | 116 | -1 | 75 |
| N.S. | 1 | 1.00 | 0.75 | 1.18 | 1.52 | 1.41 | 1.08 | 1.32 | -0.01 | 0.85 |
| time (sec) |
N/A | 0.014 | 0.073 | 0.133 | 0.337 | 0.319 | 8.849 | 0.005 | 0.000 | 10.115 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 57 | 83 | 102 | 105 | 75 | 90 | -1 | 73 |
| N.S. | 1 | 1.00 | 0.85 | 1.24 | 1.52 | 1.57 | 1.12 | 1.34 | -0.01 | 1.09 |
| time (sec) |
N/A | 0.010 | 0.063 | 0.114 | 0.352 | 0.307 | 2.519 | 0.005 | 0.000 | 4.251 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 49 | 62 | 70 | 87 | 54 | 56 | 43 | 61 |
| N.S. | 1 | 1.00 | 1.14 | 1.44 | 1.63 | 2.02 | 1.26 | 1.30 | 1.00 | 1.42 |
| time (sec) |
N/A | 0.007 | 0.045 | 0.123 | 0.347 | 0.317 | 1.018 | 0.004 | 0.585 | 2.786 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 24 | 24 | 30 | 46 | 41 | 55 | 24 | 32 | 30 | 17 |
| N.S. | 1 | 1.00 | 1.25 | 1.92 | 1.71 | 2.29 | 1.00 | 1.33 | 1.25 | 0.71 |
| time (sec) |
N/A | 0.004 | 0.027 | 0.121 | 0.336 | 0.314 | 0.469 | 0.002 | 0.035 | 2.001 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 12 | 15 | 36 | 12 | 17 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 0.75 | 0.94 | 2.25 | 0.75 | 1.06 |
| time (sec) |
N/A | 0.001 | 0.014 | 0.102 | 0.247 | 0.305 | 0.455 | 0.004 | 0.330 | 1.974 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 23 | 27 | 26 | 17 | 34 | 71 | 17 | 27 |
| N.S. | 1 | 1.00 | 0.61 | 0.71 | 0.68 | 0.45 | 0.89 | 1.87 | 0.45 | 0.71 |
| time (sec) |
N/A | 0.003 | 0.044 | 0.136 | 0.258 | 0.315 | 1.041 | 0.005 | 0.316 | 2.769 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 59 | 59 | 32 | 43 | 41 | 26 | 224 | 97 | 26 | 67 |
| N.S. | 1 | 1.00 | 0.54 | 0.73 | 0.69 | 0.44 | 3.80 | 1.64 | 0.44 | 1.14 |
| time (sec) |
N/A | 0.006 | 0.052 | 0.121 | 0.273 | 0.317 | 3.825 | 0.006 | 0.323 | 6.506 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 80 | 80 | 40 | 59 | 56 | 34 | 374 | 124 | 33 | 89 |
| N.S. | 1 | 1.00 | 0.50 | 0.74 | 0.70 | 0.42 | 4.68 | 1.55 | 0.41 | 1.11 |
| time (sec) |
N/A | 0.009 | 0.056 | 0.128 | 0.255 | 0.318 | 11.819 | 0.013 | 0.333 | 13.573 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 86 | 86 | 65 | 63 | 119 | 152 | 80 | 123 | -1 | 75 |
| N.S. | 1 | 1.00 | 0.76 | 0.73 | 1.38 | 1.77 | 0.93 | 1.43 | -0.01 | 0.87 |
| time (sec) |
N/A | 0.014 | 0.092 | 0.134 | 0.348 | 0.330 | 5.274 | 0.007 | 0.000 | 6.712 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 63 | 63 | 54 | 55 | 90 | 134 | 58 | 92 | -1 | 63 |
| N.S. | 1 | 1.00 | 0.86 | 0.87 | 1.43 | 2.13 | 0.92 | 1.46 | -0.02 | 1.00 |
| time (sec) |
N/A | 0.010 | 0.078 | 0.126 | 0.339 | 0.321 | 1.821 | 0.007 | 0.000 | 3.427 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 44 | 44 | 50 | 48 | 57 | 117 | 41 | 64 | -1 | 33 |
| N.S. | 1 | 1.00 | 1.14 | 1.09 | 1.30 | 2.66 | 0.93 | 1.45 | -0.02 | 0.75 |
| time (sec) |
N/A | 0.007 | 0.059 | 0.123 | 0.373 | 0.308 | 0.864 | 0.006 | 0.000 | 2.444 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 15 | 12 | 11 | 11 | 15 | 53 | 11 | 16 |
| N.S. | 1 | 1.00 | 1.00 | 0.80 | 0.73 | 0.73 | 1.00 | 3.53 | 0.73 | 1.07 |
| time (sec) |
N/A | 0.001 | 0.015 | 0.132 | 0.268 | 0.300 | 0.465 | 0.005 | 0.307 | 1.963 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 21 | 27 | 26 | 28 | 34 | 65 | 17 | 31 |
| N.S. | 1 | 1.00 | 0.66 | 0.84 | 0.81 | 0.88 | 1.06 | 2.03 | 0.53 | 0.97 |
| time (sec) |
N/A | 0.003 | 0.048 | 0.136 | 0.271 | 0.313 | 0.861 | 0.005 | 0.348 | 2.540 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 32 | 43 | 41 | 39 | 170 | 138 | 37 | 57 |
| N.S. | 1 | 1.00 | 0.60 | 0.81 | 0.77 | 0.74 | 3.21 | 2.60 | 0.70 | 1.08 |
| time (sec) |
N/A | 0.006 | 0.063 | 0.130 | 0.262 | 0.326 | 2.442 | 0.009 | 0.380 | 4.854 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 39 | 59 | 56 | 47 | 269 | 213 | 46 | 77 |
| N.S. | 1 | 1.00 | 0.53 | 0.80 | 0.76 | 0.64 | 3.64 | 2.88 | 0.62 | 1.04 |
| time (sec) |
N/A | 0.009 | 0.069 | 0.138 | 0.276 | 0.306 | 8.060 | 0.015 | 0.426 | 9.766 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 86 | 86 | 66 | 63 | 105 | 186 | 308 | 121 | -1 | 100 |
| N.S. | 1 | 1.00 | 0.77 | 0.73 | 1.22 | 2.16 | 3.58 | 1.41 | -0.01 | 1.16 |
| time (sec) |
N/A | 0.015 | 0.109 | 0.150 | 0.358 | 0.310 | 4.035 | 0.009 | 0.000 | 7.364 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 58 | 55 | 69 | 171 | 257 | 97 | -1 | 86 |
| N.S. | 1 | 1.00 | 0.89 | 0.85 | 1.06 | 2.63 | 3.95 | 1.49 | -0.02 | 1.32 |
| time (sec) |
N/A | 0.011 | 0.099 | 0.128 | 0.337 | 0.320 | 1.899 | 0.008 | 0.000 | 5.010 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 18 | 18 | 18 | 46 | 12 | 27 | 27 | 40 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 2.56 | 0.67 | 1.50 | 1.50 | 2.22 | 0.67 | 0.67 |
| time (sec) |
N/A | 0.001 | 0.017 | 0.103 | 0.255 | 0.305 | 0.757 | 0.007 | 0.252 | 2.398 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 37 | 37 | 23 | 26 | 24 | 32 | 75 | 102 | 42 | 32 |
| N.S. | 1 | 1.00 | 0.62 | 0.70 | 0.65 | 0.86 | 2.03 | 2.76 | 1.14 | 0.86 |
| time (sec) |
N/A | 0.003 | 0.051 | 0.123 | 0.284 | 0.313 | 1.035 | 0.011 | 0.357 | 3.328 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 55 | 55 | 32 | 42 | 40 | 45 | 117 | 96 | 57 | 48 |
| N.S. | 1 | 1.00 | 0.58 | 0.76 | 0.73 | 0.82 | 2.13 | 1.75 | 1.04 | 0.87 |
| time (sec) |
N/A | 0.005 | 0.065 | 0.131 | 0.273 | 0.312 | 2.428 | 0.007 | 0.378 | 4.435 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 71 | 71 | 40 | 58 | 55 | 55 | 257 | 166 | 71 | 76 |
| N.S. | 1 | 1.00 | 0.56 | 0.82 | 0.77 | 0.77 | 3.62 | 2.34 | 1.00 | 1.07 |
| time (sec) |
N/A | 0.006 | 0.067 | 0.131 | 0.285 | 0.308 | 4.576 | 0.012 | 0.418 | 7.240 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 91 | 91 | 72 | 111 | 117 | 125 | 204 | 123 | -1 | 163 |
| N.S. | 1 | 1.00 | 0.79 | 1.22 | 1.29 | 1.37 | 2.24 | 1.35 | -0.01 | 1.79 |
| time (sec) |
N/A | 0.016 | 0.090 | 0.131 | 0.346 | 0.330 | 8.914 | 0.005 | 0.000 | 10.116 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 69 | 69 | 63 | 89 | 85 | 107 | 162 | 95 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.91 | 1.29 | 1.23 | 1.55 | 2.35 | 1.38 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.011 | 0.078 | 0.110 | 0.351 | 0.448 | 2.554 | 0.005 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 56 | 67 | 52 | 90 | 119 | 62 | 46 | 0 |
| N.S. |
1 | 1.00 | 1.24 | 1.49 | 1.16 | 2.00 | 2.64 | 1.38 | 1.02 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.055 | 0.127 | 0.348 | 0.321 | 1.082 | 0.004 | 0.520 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 24 | 24 | 35 | 50 | 21 | 56 | 56 | 35 | 27 | 43 |
| N.S. | 1 | 1.00 | 1.46 | 2.08 | 0.88 | 2.33 | 2.33 | 1.46 | 1.12 | 1.79 |
| time (sec) |
N/A | 0.005 | 0.037 | 0.121 | 0.342 | 0.319 | 0.524 | 0.002 | 0.032 | 2.141 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 14 | 13 | 13 | 41 | 39 | 13 | 45 |
| N.S. | 1 | 1.00 | 1.00 | 0.82 | 0.76 | 0.76 | 2.41 | 2.29 | 0.76 | 2.65 |
| time (sec) |
N/A | 0.001 | 0.015 | 0.112 | 0.258 | 0.307 | 0.499 | 0.005 | 0.310 | 2.156 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 40 | 40 | 25 | 29 | 28 | 18 | 139 | 75 | 19 | 90 |
| N.S. | 1 | 1.00 | 0.62 | 0.72 | 0.70 | 0.45 | 3.48 | 1.88 | 0.48 | 2.25 |
| time (sec) |
N/A | 0.003 | 0.055 | 0.115 | 0.266 | 0.315 | 1.127 | 0.005 | 0.292 | 3.301 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 89 | 89 | 71 | 81 | 101 | 155 | 172 | 128 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.80 | 0.91 | 1.13 | 1.74 | 1.93 | 1.44 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 0.138 | 0.138 | 0.348 | 0.317 | 5.337 | 0.008 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 61 | 73 | 71 | 138 | 126 | 100 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.94 | 1.12 | 1.09 | 2.12 | 1.94 | 1.54 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.011 | 0.114 | 0.138 | 0.353 | 0.323 | 1.827 | 0.008 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 56 | 67 | 38 | 122 | 90 | 70 | -1 | 76 |
| N.S. | 1 | 1.00 | 1.24 | 1.49 | 0.84 | 2.71 | 2.00 | 1.56 | -0.02 | 1.69 |
| time (sec) |
N/A | 0.007 | 0.085 | 0.105 | 0.361 | 0.321 | 0.846 | 0.008 | 0.000 | 2.559 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 20 | 41 | 59 | 12 | 44 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 1.25 | 2.56 | 3.69 | 0.75 | 2.75 |
| time (sec) |
N/A | 0.001 | 0.018 | 0.110 | 0.266 | 0.306 | 0.495 | 0.006 | 0.299 | 2.077 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 21 | 28 | 28 | 29 | 90 | 72 | 27 | 81 |
| N.S. | 1 | 1.00 | 0.62 | 0.82 | 0.82 | 0.85 | 2.65 | 2.12 | 0.79 | 2.38 |
| time (sec) |
N/A | 0.002 | 0.062 | 0.136 | 0.270 | 0.303 | 0.935 | 0.005 | 0.321 | 2.790 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 56 | 56 | 33 | 45 | 44 | 40 | 355 | 151 | 38 | 245 |
| N.S. | 1 | 1.00 | 0.59 | 0.80 | 0.79 | 0.71 | 6.34 | 2.70 | 0.68 | 4.38 |
| time (sec) |
N/A | 0.006 | 0.080 | 0.138 | 0.304 | 0.313 | 2.626 | 0.011 | 0.362 | 4.903 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 89 | 89 | 72 | 81 | 86 | 187 | 751 | 129 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.81 | 0.91 | 0.97 | 2.10 | 8.44 | 1.45 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 0.138 | 0.124 | 0.356 | 0.313 | 4.247 | 0.010 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 64 | 73 | 50 | 173 | 648 | 101 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.96 | 1.09 | 0.75 | 2.58 | 9.67 | 1.51 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.011 | 0.119 | 0.126 | 0.343 | 0.324 | 2.067 | 0.010 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 19 | 49 | 13 | 28 | 63 | 42 | 13 | 51 |
| N.S. | 1 | 1.00 | 1.00 | 2.58 | 0.68 | 1.47 | 3.32 | 2.21 | 0.68 | 2.68 |
| time (sec) |
N/A | 0.001 | 0.067 | 0.127 | 0.259 | 0.309 | 0.823 | 0.009 | 0.232 | 2.502 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 39 | 39 | 24 | 28 | 25 | 33 | 165 | 109 | 45 | 136 |
| N.S. | 1 | 1.00 | 0.62 | 0.72 | 0.64 | 0.85 | 4.23 | 2.79 | 1.15 | 3.49 |
| time (sec) |
N/A | 0.003 | 0.067 | 0.114 | 0.268 | 0.319 | 1.114 | 0.009 | 0.357 | 3.482 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 33 | 45 | 42 | 46 | 245 | 100 | 59 | 182 |
| N.S. | 1 | 1.00 | 0.57 | 0.78 | 0.72 | 0.79 | 4.22 | 1.72 | 1.02 | 3.14 |
| time (sec) |
N/A | 0.005 | 0.081 | 0.133 | 0.273 | 0.325 | 2.546 | 0.008 | 0.367 | 4.488 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 75 | 75 | 41 | 61 | 58 | 56 | 530 | 177 | 73 | 349 |
| N.S. | 1 | 1.00 | 0.55 | 0.81 | 0.77 | 0.75 | 7.07 | 2.36 | 0.97 | 4.65 |
| time (sec) |
N/A | 0.007 | 0.094 | 0.117 | 0.259 | 0.319 | 5.784 | 0.015 | 0.438 | 7.276 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 27 | 27 | 35 | 41 | 37 | 27 | 54 | 29 | 31 | 54 |
| N.S. | 1 | 1.00 | 1.30 | 1.52 | 1.37 | 1.00 | 2.00 | 1.07 | 1.15 | 2.00 |
| time (sec) |
N/A | 0.004 | 0.056 | 0.132 | 0.340 | 0.314 | 0.913 | 0.004 | 0.570 | 2.459 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 8 | 8 | 38 | 27 | 14 | 14 | 20 | 12 | 16 | 19 |
| N.S. | 1 | 1.00 | 4.75 | 3.38 | 1.75 | 1.75 | 2.50 | 1.50 | 2.00 | 2.38 |
| time (sec) |
N/A | 0.003 | 0.025 | 0.125 | 0.347 | 0.308 | 0.461 | 0.001 | 0.051 | 1.937 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 35 | 48 | 21 | 57 | 42 | 35 | 23 | 35 |
| N.S. | 1 | 1.00 | 1.84 | 2.53 | 1.11 | 3.00 | 2.21 | 1.84 | 1.21 | 1.84 |
| time (sec) |
N/A | 0.004 | 0.040 | 0.129 | 0.355 | 0.323 | 0.506 | 0.002 | 0.125 | 2.097 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 17 | 14 | 13 | 18 | 19 | 33 | 13 | 13 |
| N.S. | 1 | 1.00 | 0.81 | 0.67 | 0.62 | 0.86 | 0.90 | 1.57 | 0.62 | 0.62 |
| time (sec) |
N/A | 0.003 | 0.009 | 0.051 | 0.277 | 0.313 | 0.321 | 0.001 | 0.028 | 1.785 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 17 | 14 | 13 | 18 | 19 | 27 | 13 | 13 |
| N.S. | 1 | 1.00 | 0.81 | 0.67 | 0.62 | 0.86 | 0.90 | 1.29 | 0.62 | 0.62 |
| time (sec) |
N/A | 0.003 | 0.009 | 0.053 | 0.257 | 0.300 | 0.241 | 0.000 | 0.025 | 1.738 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 17 | 14 | 13 | 16 | 19 | 31 | 13 | 13 |
| N.S. | 1 | 1.00 | 0.81 | 0.67 | 0.62 | 0.76 | 0.90 | 1.48 | 0.62 | 0.62 |
| time (sec) |
N/A | 0.003 | 0.009 | 0.053 | 0.255 | 0.299 | 0.138 | 0.001 | 0.024 | 1.645 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 17 | 14 | 13 | 16 | 19 | 25 | 13 | 13 |
| N.S. | 1 | 1.00 | 0.81 | 0.67 | 0.62 | 0.76 | 0.90 | 1.19 | 0.62 | 0.62 |
| time (sec) |
N/A | 0.003 | 0.009 | 0.072 | 0.273 | 0.301 | 0.703 | 0.000 | 0.025 | 2.100 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 17 | 14 | 13 | 13 | 19 | 26 | 13 | 13 |
| N.S. | 1 | 1.00 | 0.81 | 0.67 | 0.62 | 0.62 | 0.90 | 1.24 | 0.62 | 0.62 |
| time (sec) |
N/A | 0.003 | 0.009 | 0.023 | 0.276 | 0.302 | 0.779 | 0.000 | 0.024 | 2.213 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 16 | 14 | 13 | 12 | 17 | 20 | 12 | 12 |
| N.S. | 1 | 1.00 | 0.84 | 0.74 | 0.68 | 0.63 | 0.89 | 1.05 | 0.63 | 0.63 |
| time (sec) |
N/A | 0.003 | 0.009 | 0.026 | 0.275 | 0.309 | 0.528 | 0.000 | 0.023 | 1.910 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 17 | 14 | 13 | 12 | 17 | 23 | 13 | 12 |
| N.S. | 1 | 1.00 | 0.89 | 0.74 | 0.68 | 0.63 | 0.89 | 1.21 | 0.68 | 0.63 |
| time (sec) |
N/A | 0.003 | 0.011 | 0.026 | 0.262 | 0.302 | 0.181 | 0.001 | 0.027 | 1.621 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 15 | 14 | 13 | 13 | 17 | 24 | 13 | 13 |
| N.S. | 1 | 1.00 | 0.79 | 0.74 | 0.68 | 0.68 | 0.89 | 1.26 | 0.68 | 0.68 |
| time (sec) |
N/A | 0.003 | 0.011 | 0.027 | 0.266 | 0.300 | 0.196 | 0.001 | 0.026 | 1.615 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 28 | 25 | 24 | 29 | 34 | 55 | 24 | 24 |
| N.S. | 1 | 1.00 | 0.78 | 0.69 | 0.67 | 0.81 | 0.94 | 1.53 | 0.67 | 0.67 |
| time (sec) |
N/A | 0.005 | 0.013 | 0.111 | 0.260 | 0.568 | 0.485 | 0.002 | 0.045 | 1.987 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 28 | 25 | 24 | 29 | 34 | 45 | 24 | 24 |
| N.S. | 1 | 1.00 | 0.78 | 0.69 | 0.67 | 0.81 | 0.94 | 1.25 | 0.67 | 0.67 |
| time (sec) |
N/A | 0.005 | 0.013 | 0.107 | 0.259 | 0.292 | 0.385 | 0.001 | 0.038 | 1.886 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 28 | 25 | 24 | 27 | 34 | 51 | 24 | 24 |
| N.S. | 1 | 1.00 | 0.78 | 0.69 | 0.67 | 0.75 | 0.94 | 1.42 | 0.67 | 0.67 |
| time (sec) |
N/A | 0.005 | 0.013 | 0.092 | 0.270 | 0.302 | 0.232 | 0.001 | 0.038 | 1.760 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 28 | 25 | 24 | 27 | 2633 | 43 | 24 | 1235 |
| N.S. | 1 | 1.00 | 0.78 | 0.69 | 0.67 | 0.75 | 73.14 | 1.19 | 0.67 | 34.31 |
| time (sec) |
N/A | 0.005 | 0.012 | 0.095 | 0.273 | 0.299 | 1.123 | 0.001 | 0.035 | 13.426 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 28 | 25 | 24 | 24 | 1765 | 48 | 24 | 965 |
| N.S. | 1 | 1.00 | 0.78 | 0.69 | 0.67 | 0.67 | 49.03 | 1.33 | 0.67 | 26.81 |
| time (sec) |
N/A | 0.006 | 0.013 | 0.105 | 0.252 | 0.311 | 1.033 | 0.001 | 0.038 | 10.446 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 28 | 25 | 24 | 24 | 1741 | 38 | 24 | 965 |
| N.S. | 1 | 1.00 | 0.82 | 0.74 | 0.71 | 0.71 | 51.21 | 1.12 | 0.71 | 28.38 |
| time (sec) |
N/A | 0.006 | 0.013 | 0.111 | 0.256 | 0.304 | 1.061 | 0.001 | 0.034 | 10.151 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 28 | 25 | 24 | 23 | 1826 | 39 | 24 | 968 |
| N.S. | 1 | 1.00 | 0.88 | 0.78 | 0.75 | 0.72 | 57.06 | 1.22 | 0.75 | 30.25 |
| time (sec) |
N/A | 0.005 | 0.015 | 0.097 | 0.262 | 0.295 | 1.067 | 0.002 | 0.037 | 10.871 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 28 | 25 | 24 | 23 | 1957 | 40 | 24 | 968 |
| N.S. | 1 | 1.00 | 0.82 | 0.74 | 0.71 | 0.68 | 57.56 | 1.18 | 0.71 | 28.47 |
| time (sec) |
N/A | 0.005 | 0.015 | 0.102 | 0.272 | 0.298 | 1.059 | 0.001 | 0.036 | 10.743 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 39 | 36 | 35 | 40 | 49 | 75 | 35 | 35 |
| N.S. | 1 | 1.00 | 0.76 | 0.71 | 0.69 | 0.78 | 0.96 | 1.47 | 0.69 | 0.69 |
| time (sec) |
N/A | 0.008 | 0.015 | 0.102 | 0.266 | 0.291 | 0.683 | 0.001 | 0.043 | 2.196 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 39 | 36 | 35 | 40 | 49 | 63 | 35 | 35 |
| N.S. | 1 | 1.00 | 0.76 | 0.71 | 0.69 | 0.78 | 0.96 | 1.24 | 0.69 | 0.69 |
| time (sec) |
N/A | 0.008 | 0.015 | 0.124 | 0.249 | 0.300 | 0.550 | 0.001 | 0.044 | 2.104 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 39 | 36 | 35 | 38 | 49 | 73 | 35 | 35 |
| N.S. | 1 | 1.00 | 0.76 | 0.71 | 0.69 | 0.75 | 0.96 | 1.43 | 0.69 | 0.69 |
| time (sec) |
N/A | 0.008 | 0.015 | 0.113 | 0.247 | 0.519 | 0.333 | 0.001 | 0.044 | 1.925 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 39 | 36 | 35 | 38 | 5012 | 61 | 35 | 2649 |
| N.S. | 1 | 1.00 | 0.76 | 0.71 | 0.69 | 0.75 | 98.27 | 1.20 | 0.69 | 51.94 |
| time (sec) |
N/A | 0.008 | 0.014 | 0.094 | 0.273 | 0.303 | 1.621 | 0.001 | 0.048 | 27.183 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 39 | 36 | 35 | 35 | 6246 | 68 | 35 | 3003 |
| N.S. | 1 | 1.00 | 0.76 | 0.71 | 0.69 | 0.69 | 122.47 | 1.33 | 0.69 | 58.88 |
| time (sec) |
N/A | 0.008 | 0.014 | 0.110 | 0.272 | 0.303 | 1.568 | 0.001 | 0.044 | 32.859 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 39 | 36 | 35 | 35 | 6667 | 56 | 35 | 3003 |
| N.S. | 1 | 1.00 | 0.80 | 0.73 | 0.71 | 0.71 | 136.06 | 1.14 | 0.71 | 61.29 |
| time (sec) |
N/A | 0.008 | 0.014 | 0.092 | 0.256 | 0.348 | 1.583 | 0.001 | 0.044 | 33.407 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 39 | 36 | 35 | 35 | 4004 | 61 | 35 | 2278 |
| N.S. | 1 | 1.00 | 0.80 | 0.73 | 0.71 | 0.71 | 81.71 | 1.24 | 0.71 | 46.49 |
| time (sec) |
N/A | 0.008 | 0.017 | 0.098 | 0.255 | 0.306 | 1.625 | 0.002 | 0.044 | 23.094 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 39 | 36 | 35 | 35 | 3964 | 58 | 35 | 2278 |
| N.S. | 1 | 1.00 | 0.80 | 0.73 | 0.71 | 0.71 | 80.90 | 1.18 | 0.71 | 46.49 |
| time (sec) |
N/A | 0.008 | 0.017 | 0.111 | 0.269 | 0.314 | 1.630 | 0.001 | 0.043 | 23.093 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 125 | 125 | 140 | 124 | 130 | 147 | 180 | 214 | 151 | 173 |
| N.S. | 1 | 1.00 | 1.12 | 0.99 | 1.04 | 1.18 | 1.44 | 1.71 | 1.21 | 1.38 |
| time (sec) |
N/A | 0.050 | 0.088 | 0.122 | 0.355 | 0.316 | 46.953 | 0.006 | 0.243 | 45.165 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 123 | 123 | 140 | 123 | 128 | 116 | 173 | 194 | 126 | 168 |
| N.S. | 1 | 1.00 | 1.14 | 1.00 | 1.04 | 0.94 | 1.41 | 1.58 | 1.02 | 1.37 |
| time (sec) |
N/A | 0.041 | 0.073 | 0.173 | 0.347 | 0.317 | 21.264 | 0.005 | 0.068 | 10.514 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 111 | 111 | 127 | 112 | 114 | 128 | 162 | 187 | 130 | 160 |
| N.S. | 1 | 1.00 | 1.14 | 1.01 | 1.03 | 1.15 | 1.46 | 1.68 | 1.17 | 1.44 |
| time (sec) |
N/A | 0.028 | 0.063 | 0.112 | 0.349 | 0.315 | 4.327 | 0.006 | 0.150 | 5.449 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 109 | 109 | 126 | 112 | 115 | 114 | 148 | 165 | 126 | 156 |
| N.S. | 1 | 1.00 | 1.16 | 1.03 | 1.06 | 1.05 | 1.36 | 1.51 | 1.16 | 1.43 |
| time (sec) |
N/A | 0.028 | 0.060 | 0.146 | 0.399 | 0.317 | 2.332 | 0.005 | 0.074 | 3.655 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 103 | 96 | 103 | 313 | 141 | 171 | 120 | 147 |
| N.S. | 1 | 1.00 | 1.03 | 0.96 | 1.03 | 3.13 | 1.41 | 1.71 | 1.20 | 1.47 |
| time (sec) |
N/A | 0.022 | 0.049 | 0.117 | 0.345 | 0.333 | 2.626 | 0.005 | 0.113 | 4.027 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 103 | 95 | 102 | 307 | 141 | 153 | 110 | 148 |
| N.S. | 1 | 1.00 | 1.03 | 0.95 | 1.02 | 3.07 | 1.41 | 1.53 | 1.10 | 1.48 |
| time (sec) |
N/A | 0.021 | 0.053 | 0.098 | 0.340 | 0.320 | 6.548 | 0.002 | 0.206 | 5.407 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 109 | 109 | 127 | 112 | 111 | 113 | 151 | 183 | 124 | 157 |
| N.S. | 1 | 1.00 | 1.17 | 1.03 | 1.02 | 1.04 | 1.39 | 1.68 | 1.14 | 1.44 |
| time (sec) |
N/A | 0.028 | 0.080 | 0.118 | 0.354 | 0.321 | 23.787 | 0.005 | 0.147 | 10.151 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 111 | 111 | 126 | 112 | 112 | 147 | 155 | 173 | 138 | 156 |
| N.S. | 1 | 1.00 | 1.14 | 1.01 | 1.01 | 1.32 | 1.40 | 1.56 | 1.24 | 1.41 |
| time (sec) |
N/A | 0.028 | 0.080 | 0.172 | 0.353 | 0.306 | 41.418 | 0.003 | 0.072 | 41.431 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-1) | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 129 | 129 | 142 | 124 | 133 | 162 | 0 | 217 | 150 | 566 |
| N.S. |
1 | 1.00 | 1.10 | 0.96 | 1.03 | 1.26 | 0.00 | 1.68 | 1.16 | 4.39 |
| time (sec) |
N/A | 0.035 | 0.183 | 0.115 | 0.351 | 0.333 | 0.000 | 0.007 | 0.265 | 85.399 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-1) | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 125 | 125 | 142 | 124 | 133 | 147 | 0 | 196 | 142 | 439 |
| N.S. |
1 | 1.00 | 1.14 | 0.99 | 1.06 | 1.18 | 0.00 | 1.57 | 1.14 | 3.51 |
| time (sec) |
N/A | 0.034 | 0.178 | 0.258 | 0.352 | 0.333 | 0.000 | 0.006 | 0.152 | 66.084 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 115 | 115 | 133 | 118 | 120 | 394 | 527 | 198 | 142 | 506 |
| N.S. | 1 | 1.00 | 1.16 | 1.03 | 1.04 | 3.43 | 4.58 | 1.72 | 1.23 | 4.40 |
| time (sec) |
N/A | 0.028 | 0.156 | 0.107 | 0.364 | 0.331 | 95.939 | 0.006 | 0.236 | 94.061 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 117 | 117 | 134 | 117 | 120 | 389 | 450 | 180 | 120 | 425 |
| N.S. | 1 | 1.00 | 1.15 | 1.00 | 1.03 | 3.32 | 3.85 | 1.54 | 1.03 | 3.63 |
| time (sec) |
N/A | 0.028 | 0.151 | 0.102 | 0.351 | 0.326 | 60.304 | 0.006 | 0.063 | 59.099 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 116 | 116 | 133 | 116 | 127 | 396 | 544 | 200 | 144 | 515 |
| N.S. | 1 | 1.00 | 1.15 | 1.00 | 1.09 | 3.41 | 4.69 | 1.72 | 1.24 | 4.44 |
| time (sec) |
N/A | 0.029 | 0.144 | 0.102 | 0.360 | 0.330 | 61.766 | 0.006 | 0.358 | 60.092 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 113 | 113 | 134 | 117 | 127 | 387 | 434 | 182 | 134 | 416 |
| N.S. | 1 | 1.00 | 1.19 | 1.04 | 1.12 | 3.42 | 3.84 | 1.61 | 1.19 | 3.68 |
| time (sec) |
N/A | 0.028 | 0.142 | 0.113 | 0.349 | 0.323 | 109.515 | 0.004 | 0.223 | 39.785 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-1) | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 124 | 124 | 142 | 124 | 132 | 156 | 0 | 215 | 151 | 616 |
| N.S. |
1 | 1.00 | 1.15 | 1.00 | 1.06 | 1.26 | 0.00 | 1.73 | 1.22 | 4.97 |
| time (sec) |
N/A | 0.035 | 0.195 | 0.145 | 0.354 | 0.319 | 0.000 | 0.007 | 0.152 | 83.358 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 128 | 128 | 142 | 124 | 132 | 189 | 0 | 203 | 166 | 0 |
| N.S. |
1 | 1.00 | 1.11 | 0.97 | 1.03 | 1.48 | 0.00 | 1.59 | 1.30 | 0.00 |
| time (sec) |
N/A | 0.034 | 0.201 | 0.223 | 0.344 | 0.323 | 0.000 | 0.004 | 0.165 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 140 | 140 | 142 | 130 | 143 | 506 | 0 | 221 | 165 | 0 |
| N.S. |
1 | 1.00 | 1.01 | 0.93 | 1.02 | 3.61 | 0.00 | 1.58 | 1.18 | 0.00 |
| time (sec) |
N/A | 0.036 | 0.216 | 0.119 | 0.360 | 0.326 | 0.000 | 0.008 | 0.172 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 140 | 140 | 142 | 130 | 143 | 503 | 0 | 202 | 139 | 0 |
| N.S. |
1 | 1.00 | 1.01 | 0.93 | 1.02 | 3.59 | 0.00 | 1.44 | 0.99 | 0.00 |
| time (sec) |
N/A | 0.035 | 0.208 | 0.118 | 0.357 | 0.321 | 0.000 | 0.007 | 0.066 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 143 | 143 | 133 | 132 | 153 | 508 | 0 | 220 | 172 | 0 |
| N.S. |
1 | 1.00 | 0.93 | 0.92 | 1.07 | 3.55 | 0.00 | 1.54 | 1.20 | 0.00 |
| time (sec) |
N/A | 0.034 | 0.200 | 0.099 | 0.341 | 0.322 | 0.000 | 0.008 | 0.265 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 143 | 143 | 136 | 132 | 152 | 501 | 0 | 202 | 146 | 0 |
| N.S. |
1 | 1.00 | 0.95 | 0.92 | 1.06 | 3.50 | 0.00 | 1.41 | 1.02 | 0.00 |
| time (sec) |
N/A | 0.034 | 0.193 | 0.106 | 0.345 | 0.342 | 0.000 | 0.007 | 0.235 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 140 | 140 | 142 | 139 | 151 | 510 | 0 | 221 | 167 | 0 |
| N.S. |
1 | 1.00 | 1.01 | 0.99 | 1.08 | 3.64 | 0.00 | 1.58 | 1.19 | 0.00 |
| time (sec) |
N/A | 0.034 | 0.141 | 0.112 | 0.347 | 0.331 | 0.000 | 0.007 | 0.192 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 140 | 140 | 142 | 139 | 151 | 499 | 0 | 200 | 157 | 0 |
| N.S. |
1 | 1.00 | 1.01 | 0.99 | 1.08 | 3.56 | 0.00 | 1.43 | 1.12 | 0.00 |
| time (sec) |
N/A | 0.037 | 0.138 | 0.126 | 0.367 | 0.339 | 0.000 | 0.004 | 0.241 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 152 | 152 | 153 | 133 | 154 | 211 | 0 | 235 | 174 | 0 |
| N.S. |
1 | 1.00 | 1.01 | 0.88 | 1.01 | 1.39 | 0.00 | 1.55 | 1.14 | 0.00 |
| time (sec) |
N/A | 0.044 | 0.245 | 0.138 | 0.361 | 0.317 | 0.000 | 0.008 | 0.087 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 152 | 152 | 153 | 133 | 154 | 244 | 0 | 214 | 182 | 0 |
| N.S. |
1 | 1.00 | 1.01 | 0.88 | 1.01 | 1.61 | 0.00 | 1.41 | 1.20 | 0.00 |
| time (sec) |
N/A | 0.045 | 0.244 | 0.158 | 0.353 | 0.313 | 0.000 | 0.005 | 0.173 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 58 | 60 | 61 | 82 | 243 | 80 | 46 | 98 |
| N.S. | 1 | 1.00 | 1.00 | 1.03 | 1.05 | 1.41 | 4.19 | 1.38 | 0.79 | 1.69 |
| time (sec) |
N/A | 0.019 | 0.063 | 1.208 | 0.368 | 0.313 | 1.282 | 0.013 | 0.068 | 4.029 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 187 | 187 | 166 | 1534 | 187 | 1277 | 9996 | 2166 | 1274 | 9691 |
| N.S. | 1 | 1.00 | 0.89 | 8.20 | 1.00 | 6.83 | 53.45 | 11.58 | 6.81 | 51.82 |
| time (sec) |
N/A | 0.060 | 0.182 | 0.107 | 0.268 | 0.328 | 1.227 | 0.016 | 1.370 | 8.775 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 133 | 133 | 118 | 156 | 133 | 665 | 4257 | 1119 | 683 | 4128 |
| N.S. | 1 | 1.00 | 0.89 | 1.17 | 1.00 | 5.00 | 32.01 | 8.41 | 5.14 | 31.04 |
| time (sec) |
N/A | 0.034 | 0.075 | 0.105 | 0.260 | 0.322 | 0.707 | 0.007 | 0.777 | 5.366 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 54 | 72 | 61 | 157 | 663 | 255 | 167 | 662 |
| N.S. | 1 | 1.00 | 0.89 | 1.18 | 1.00 | 2.57 | 10.87 | 4.18 | 2.74 | 10.85 |
| time (sec) |
N/A | 0.013 | 0.020 | 0.096 | 0.256 | 0.332 | 0.278 | 0.004 | 0.443 | 2.485 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 38 | 51 | 43 | 85 | 299 | 134 | 93 | 311 |
| N.S. | 1 | 1.00 | 0.88 | 1.19 | 1.00 | 1.98 | 6.95 | 3.12 | 2.16 | 7.23 |
| time (sec) |
N/A | 0.009 | 0.017 | 0.117 | 0.272 | 0.321 | 0.194 | 0.002 | 0.370 | 1.983 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 25 | 25 | 22 | 30 | 25 | 33 | 87 | 50 | 30 | 101 |
| N.S. | 1 | 1.00 | 0.88 | 1.20 | 1.00 | 1.32 | 3.48 | 2.00 | 1.20 | 4.04 |
| time (sec) |
N/A | 0.005 | 0.010 | 0.010 | 0.272 | 0.309 | 0.130 | 0.002 | 0.304 | 1.677 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 29 | 0 | 0 | 0 | 61 | 0 | -1 | 24 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 2.10 | 0.00 | -0.03 | 0.83 |
| time (sec) |
N/A | 0.004 | 0.024 | 0.028 | 0.000 | 0.315 | 0.376 | 0.000 | 0.000 | 2.222 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 29 | 0 | 0 | 0 | 262 | 0 | -1 | 57 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 9.03 | 0.00 | -0.03 | 1.97 |
| time (sec) |
N/A | 0.004 | 0.019 | 0.032 | 0.000 | 0.310 | 0.503 | 0.000 | 0.000 | 4.007 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 29 | 0 | 0 | 0 | 717 | 0 | -1 | 155 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 24.72 | 0.00 | -0.03 | 5.34 |
| time (sec) |
N/A | 0.004 | 0.019 | 0.036 | 0.000 | 0.330 | 0.682 | 0.000 | 0.000 | 7.459 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 48 | 0 | 0 | 0 | 37 | 0 | -1 | 34 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.77 | 0.00 | -0.02 | 0.71 |
| time (sec) |
N/A | 0.008 | 0.092 | 0.026 | 0.000 | 0.313 | 6.457 | 0.000 | 0.000 | 6.867 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 48 | 0 | 0 | 0 | 37 | 0 | -1 | 34 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.77 | 0.00 | -0.02 | 0.71 |
| time (sec) |
N/A | 0.008 | 0.078 | 0.027 | 0.000 | 0.320 | 1.843 | 0.000 | 0.000 | 3.311 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 48 | 0 | 0 | 0 | 37 | 0 | -1 | 34 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.77 | 0.00 | -0.02 | 0.71 |
| time (sec) |
N/A | 0.008 | 0.056 | 0.025 | 0.000 | 0.313 | 0.810 | 0.000 | 0.000 | 2.463 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 46 | 46 | 46 | 0 | 0 | 0 | 36 | 0 | -1 | 34 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.78 | 0.00 | -0.02 | 0.74 |
| time (sec) |
N/A | 0.009 | 0.051 | 0.028 | 0.000 | 0.321 | 0.719 | 0.000 | 0.000 | 2.396 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 46 | 46 | 46 | 0 | 0 | 0 | 36 | 0 | -1 | 34 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.78 | 0.00 | -0.02 | 0.74 |
| time (sec) |
N/A | 0.008 | 0.076 | 0.029 | 0.000 | 0.327 | 0.928 | 0.000 | 0.000 | 2.568 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 48 | 0 | 0 | 0 | 36 | 0 | -1 | 34 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.75 | 0.00 | -0.02 | 0.71 |
| time (sec) |
N/A | 0.009 | 0.077 | 0.026 | 0.000 | 0.322 | 1.927 | 0.000 | 0.000 | 3.342 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 51 | 0 | 0 | 0 | 37 | 0 | -1 | 34 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.73 | 0.00 | -0.02 | 0.67 |
| time (sec) |
N/A | 0.009 | 0.070 | 0.027 | 0.000 | 0.320 | 1.729 | 0.000 | 0.000 | 3.253 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 49 | 0 | 0 | 0 | 37 | 0 | -1 | 34 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.76 | 0.00 | -0.02 | 0.69 |
| time (sec) |
N/A | 0.009 | 0.065 | 0.031 | 0.000 | 0.317 | 1.240 | 0.000 | 0.000 | 2.830 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 46 | 46 | 46 | 0 | 0 | 0 | 36 | 0 | -1 | 34 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.78 | 0.00 | -0.02 | 0.74 |
| time (sec) |
N/A | 0.008 | 0.007 | 0.003 | 0.000 | 0.642 | 0.721 | 0.000 | 0.000 | 2.395 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 48 | 0 | 0 | 0 | 31 | 0 | -1 | 28 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.65 | 0.00 | -0.02 | 0.58 |
| time (sec) |
N/A | 0.009 | 0.065 | 0.028 | 0.000 | 0.316 | 1.976 | 0.000 | 0.000 | 3.383 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 49 | 0 | 0 | 0 | 32 | 0 | -1 | 32 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.65 | 0.00 | -0.02 | 0.65 |
| time (sec) |
N/A | 0.009 | 0.066 | 0.027 | 0.000 | 0.324 | 5.580 | 0.000 | 0.000 | 6.332 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 51 | 0 | 0 | 0 | 37 | 0 | -1 | 34 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.73 | 0.00 | -0.02 | 0.67 |
| time (sec) |
N/A | 0.010 | 0.073 | 0.028 | 0.000 | 0.313 | 16.566 | 0.000 | 0.000 | 14.485 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 31 | 31 | 31 | 29 | 0 | 0 | 37 | 0 | -1 | 32 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 0.00 | 0.00 | 1.19 | 0.00 | -0.03 | 1.03 |
| time (sec) |
N/A | 0.005 | 0.036 | 0.100 | 0.000 | 0.320 | 0.597 | 0.000 | 0.000 | 2.268 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 31 | 31 | 31 | 29 | 0 | 0 | 46 | 0 | -1 | 33 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 0.00 | 0.00 | 1.48 | 0.00 | -0.03 | 1.06 |
| time (sec) |
N/A | 0.004 | 0.035 | 0.115 | 0.000 | 0.330 | 0.609 | 0.000 | 0.000 | 2.279 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | C | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 36 | 43 | 0 | 0 | 36 | 0 | -1 | 30 |
| N.S. | 1 | 1.00 | 1.00 | 1.19 | 0.00 | 0.00 | 1.00 | 0.00 | -0.03 | 0.83 |
| time (sec) |
N/A | 0.007 | 0.034 | 0.130 | 0.000 | 0.313 | 0.608 | 0.000 | 0.000 | 2.255 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | C | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 50 | 50 | 48 | 30 | 0 | 0 | 41 | 0 | -1 | 34 |
| N.S. | 1 | 1.00 | 0.96 | 0.60 | 0.00 | 0.00 | 0.82 | 0.00 | -0.02 | 0.68 |
| time (sec) |
N/A | 0.009 | 0.046 | 0.098 | 0.000 | 0.315 | 0.603 | 0.000 | 0.000 | 2.281 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 48 | 0 | 0 | 0 | 42 | 0 | -1 | 40 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.88 | 0.00 | -0.02 | 0.83 |
| time (sec) |
N/A | 0.009 | 0.010 | 0.027 | 0.000 | 0.326 | 0.732 | 0.000 | 0.000 | 2.439 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 32 | 30 | 0 | 0 | 44 | 0 | -1 | 32 |
| N.S. | 1 | 1.00 | 0.94 | 0.88 | 0.00 | 0.00 | 1.29 | 0.00 | -0.03 | 0.94 |
| time (sec) |
N/A | 0.005 | 0.005 | 0.105 | 0.000 | 0.316 | 0.591 | 0.000 | 0.000 | 2.282 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 34 | 34 | 32 | 30 | 0 | 0 | 53 | 0 | -1 | 39 |
| N.S. | 1 | 1.00 | 0.94 | 0.88 | 0.00 | 0.00 | 1.56 | 0.00 | -0.03 | 1.15 |
| time (sec) |
N/A | 0.004 | 0.005 | 0.129 | 0.000 | 0.317 | 0.626 | 0.000 | 0.000 | 2.364 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | C | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 49 | 44 | 0 | 0 | 42 | 0 | -1 | 36 |
| N.S. | 1 | 1.00 | 1.00 | 0.90 | 0.00 | 0.00 | 0.86 | 0.00 | -0.02 | 0.73 |
| time (sec) |
N/A | 0.009 | 0.006 | 0.131 | 0.000 | 0.310 | 0.621 | 0.000 | 0.000 | 2.307 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | C | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 37 | 37 | 57 | 31 | 0 | 0 | 48 | 0 | -1 | 33 |
| N.S. | 1 | 1.00 | 1.54 | 0.84 | 0.00 | 0.00 | 1.30 | 0.00 | -0.03 | 0.89 |
| time (sec) |
N/A | 0.004 | 0.010 | 0.119 | 0.000 | 0.309 | 0.583 | 0.000 | 0.000 | 2.296 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 26 | 26 | 26 | 23 | 0 | 0 | 26 | 0 | -1 | 23 |
| N.S. | 1 | 1.00 | 1.00 | 0.88 | 0.00 | 0.00 | 1.00 | 0.00 | -0.04 | 0.88 |
| time (sec) |
N/A | 0.003 | 0.032 | 0.110 | 0.000 | 0.320 | 0.524 | 0.000 | 0.000 | 2.142 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 0 | 0 | 0 | 31 | 0 | -1 | 26 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 1.03 | 0.00 | -0.03 | 0.87 |
| time (sec) |
N/A | 0.004 | 0.103 | 0.032 | 0.000 | 0.323 | 0.549 | 0.000 | 0.000 | 2.185 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 47 | 0 | 0 | 0 | 34 | 0 | -1 | 36 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.72 | 0.00 | -0.02 | 0.77 |
| time (sec) |
N/A | 0.008 | 0.021 | 0.040 | 0.000 | 0.318 | 1.728 | 0.000 | 0.000 | 3.371 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 52 | 52 | 48 | 0 | 0 | 0 | 37 | 0 | -1 | 39 |
| N.S. | 1 | 1.00 | 0.92 | 0.00 | 0.00 | 0.00 | 0.71 | 0.00 | -0.02 | 0.75 |
| time (sec) |
N/A | 0.011 | 0.007 | 0.055 | 0.000 | 0.743 | 1.516 | 0.000 | 0.000 | 3.163 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 83 | 83 | 67 | 126 | 101 | 143 | 1318 | 250 | 176 | 929 |
| N.S. | 1 | 1.00 | 0.81 | 1.52 | 1.22 | 1.72 | 15.88 | 3.01 | 2.12 | 11.19 |
| time (sec) |
N/A | 0.022 | 0.055 | 0.107 | 0.271 | 0.331 | 0.632 | 0.002 | 0.534 | 7.731 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 60 | 60 | 57 | 73 | 68 | 96 | 597 | 154 | 192 | 496 |
| N.S. | 1 | 1.00 | 0.95 | 1.22 | 1.13 | 1.60 | 9.95 | 2.57 | 3.20 | 8.27 |
| time (sec) |
N/A | 0.014 | 0.035 | 0.114 | 0.283 | 0.321 | 0.408 | 0.002 | 0.557 | 4.324 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 39 | 39 | 33 | 36 | 42 | 53 | 201 | 83 | 94 | 213 |
| N.S. | 1 | 1.00 | 0.85 | 0.92 | 1.08 | 1.36 | 5.15 | 2.13 | 2.41 | 5.46 |
| time (sec) |
N/A | 0.009 | 0.025 | 0.122 | 0.260 | 0.309 | 0.249 | 0.002 | 0.378 | 2.401 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 18 | 18 | 17 | 19 | 18 | 20 | 20 | 16 | 18 | 0 |
| N.S. |
1 | 1.00 | 0.94 | 1.06 | 1.00 | 1.11 | 1.11 | 0.89 | 1.00 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.016 | 0.112 | 0.259 | 0.313 | 0.029 | 0.000 | 0.198 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | B | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 35 | 0 | 0 | 0 | 83 | 0 | -1 | 40 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 2.37 | 0.00 | -0.03 | 1.14 |
| time (sec) |
N/A | 0.005 | 0.021 | 0.028 | 0.000 | 0.315 | 0.644 | 0.000 | 0.000 | 2.866 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | B | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 35 | 0 | 0 | 0 | 354 | 0 | -1 | 75 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 10.11 | 0.00 | -0.03 | 2.14 |
| time (sec) |
N/A | 0.005 | 0.021 | 0.044 | 0.000 | 0.314 | 0.959 | 0.000 | 0.000 | 5.614 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | B | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 38 | 0 | 0 | 0 | 918 | 0 | -1 | 150 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 24.16 | 0.00 | -0.03 | 3.95 |
| time (sec) |
N/A | 0.006 | 0.021 | 0.030 | 0.000 | 0.326 | 1.990 | 0.000 | 0.000 | 11.581 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-2) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 110 | 110 | 64 | 77 | 0 | 104 | 0 | 0 | 136 | 0 |
| N.S. |
1 | 1.00 | 0.58 | 0.70 | 0.00 | 0.95 | 0.00 | 0.00 | 1.24 | 0.00 |
| time (sec) |
N/A | 0.028 | 0.035 | 0.127 | 0.000 | 0.320 | 0.000 | 0.000 | 0.523 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-1) | F | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 39 | 44 | 0 | 64 | 0 | 0 | 80 | 344 |
| N.S. |
1 | 1.00 | 0.61 | 0.69 | 0.00 | 1.00 | 0.00 | 0.00 | 1.25 | 5.38 |
| time (sec) |
N/A | 0.007 | 0.029 | 0.115 | 0.000 | 0.319 | 0.000 | 0.000 | 0.447 | 190.943 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | A | F | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 25 | 29 | 0 | 33 | 85 | 0 | 29 | 120 |
| N.S. | 1 | 1.00 | 0.89 | 1.04 | 0.00 | 1.18 | 3.04 | 0.00 | 1.04 | 4.29 |
| time (sec) |
N/A | 0.002 | 0.021 | 0.116 | 0.000 | 0.322 | 98.359 | 0.000 | 0.349 | 169.746 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 39 | 39 | 39 | 0 | 0 | 0 | 27 | 0 | -1 | 30 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.69 | 0.00 | -0.03 | 0.77 |
| time (sec) |
N/A | 0.007 | 0.022 | 0.046 | 0.000 | 0.323 | 148.891 | 0.000 | 0.000 | 154.034 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 45 | 0 | 0 | 0 | 32 | 0 | -1 | 36 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.71 | 0.00 | -0.02 | 0.80 |
| time (sec) |
N/A | 0.008 | 0.020 | 0.043 | 0.000 | 0.310 | 13.843 | 0.000 | 0.000 | 15.250 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 45 | 0 | 0 | 0 | 34 | 0 | -1 | 36 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.76 | 0.00 | -0.02 | 0.80 |
| time (sec) |
N/A | 0.008 | 0.023 | 0.054 | 0.000 | 0.323 | 156.365 | 0.000 | 0.000 | 109.859 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 45 | 0 | 0 | 0 | 27 | 0 | -1 | 26 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.60 | 0.00 | -0.02 | 0.58 |
| time (sec) |
N/A | 0.007 | 0.079 | 0.027 | 0.000 | 0.328 | 77.311 | 0.000 | 0.000 | 39.614 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 45 | 0 | 0 | 0 | 27 | 0 | -1 | 26 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.60 | 0.00 | -0.02 | 0.58 |
| time (sec) |
N/A | 0.007 | 0.050 | 0.025 | 0.000 | 0.317 | 3.768 | 0.000 | 0.000 | 5.180 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 43 | 0 | 0 | 0 | 26 | 0 | -1 | 26 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.60 | 0.00 | -0.02 | 0.60 |
| time (sec) |
N/A | 0.007 | 0.054 | 0.026 | 0.000 | 0.317 | 2.351 | 0.000 | 0.000 | 3.867 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 43 | 0 | 0 | 0 | 29 | 0 | -1 | 26 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.67 | 0.00 | -0.02 | 0.60 |
| time (sec) |
N/A | 0.007 | 0.088 | 0.027 | 0.000 | 0.323 | 14.715 | 0.000 | 0.000 | 15.300 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-1) | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 45 | 0 | 0 | 0 | 0 | 0 | -1 | 26 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.58 |
| time (sec) |
N/A | 0.007 | 0.068 | 0.024 | 0.000 | 0.331 | 0.000 | 0.000 | 0.000 | 172.893 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 31 | 32 | 0 | 0 | 37 | 0 | -1 | 37 |
| N.S. | 1 | 1.00 | 0.89 | 0.91 | 0.00 | 0.00 | 1.06 | 0.00 | -0.03 | 1.06 |
| time (sec) |
N/A | 0.009 | 0.018 | 0.132 | 0.000 | 0.317 | 1.243 | 0.000 | 0.000 | 2.873 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 40 | 40 | 44 | 0 | 0 | 0 | 37 | 0 | -1 | 36 |
| N.S. | 1 | 1.00 | 1.10 | 0.00 | 0.00 | 0.00 | 0.92 | 0.00 | -0.02 | 0.90 |
| time (sec) |
N/A | 0.007 | 0.045 | 0.060 | 0.000 | 0.312 | 1.267 | 0.000 | 0.000 | 2.860 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 52 | 52 | 48 | 0 | 0 | 0 | 37 | 0 | -1 | 39 |
| N.S. | 1 | 1.00 | 0.92 | 0.00 | 0.00 | 0.00 | 0.71 | 0.00 | -0.02 | 0.75 |
| time (sec) |
N/A | 0.010 | 0.021 | 0.040 | 0.000 | 0.315 | 1.553 | 0.000 | 0.000 | 3.151 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | F | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 19 | 20 | 22 | 32 | 197 | 0 | 19 | 236 |
| N.S. | 1 | 1.00 | 1.00 | 1.05 | 1.16 | 1.68 | 10.37 | 0.00 | 1.00 | 12.42 |
| time (sec) |
N/A | 0.002 | 0.027 | 0.113 | 0.330 | 0.322 | 128.509 | 0.000 | 0.504 | 202.575 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | A | F | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 40 | 41 | 0 | 64 | 328 | 0 | 86 | 302 |
| N.S. | 1 | 1.00 | 0.69 | 0.71 | 0.00 | 1.10 | 5.66 | 0.00 | 1.48 | 5.21 |
| time (sec) |
N/A | 0.010 | 0.028 | 0.121 | 0.000 | 0.324 | 17.455 | 0.000 | 0.498 | 41.602 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | A | F | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 40 | 41 | 0 | 64 | 328 | 0 | 86 | 302 |
| N.S. | 1 | 1.00 | 0.69 | 0.71 | 0.00 | 1.10 | 5.66 | 0.00 | 1.48 | 5.21 |
| time (sec) |
N/A | 0.009 | 0.003 | 0.120 | 0.000 | 0.316 | 17.516 | 0.000 | 0.002 | 18.004 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 24 | 21 | 33 | 22 | 29 | 25 | -1 | 19 |
| N.S. | 1 | 1.00 | 0.69 | 0.60 | 0.94 | 0.63 | 0.83 | 0.71 | -0.03 | 0.54 |
| time (sec) |
N/A | 0.008 | 0.003 | 0.025 | 0.263 | 0.296 | 0.145 | 0.001 | 0.000 | 1.733 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 24 | 21 | 31 | 22 | 29 | 25 | -1 | 19 |
| N.S. | 1 | 1.00 | 0.69 | 0.60 | 0.89 | 0.63 | 0.83 | 0.71 | -0.03 | 0.54 |
| time (sec) |
N/A | 0.007 | 0.003 | 0.024 | 0.259 | 0.304 | 0.120 | 0.000 | 0.000 | 1.722 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 24 | 21 | 28 | 22 | 29 | 25 | -1 | 19 |
| N.S. | 1 | 1.00 | 0.69 | 0.60 | 0.80 | 0.63 | 0.83 | 0.71 | -0.03 | 0.54 |
| time (sec) |
N/A | 0.006 | 0.002 | 0.022 | 0.265 | 0.304 | 0.104 | 0.000 | 0.000 | 1.695 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 33 | 33 | 22 | 19 | 25 | 20 | 27 | 25 | 20 | 18 |
| N.S. | 1 | 1.00 | 0.67 | 0.58 | 0.76 | 0.61 | 0.82 | 0.76 | 0.61 | 0.55 |
| time (sec) |
N/A | 0.006 | 0.002 | 0.021 | 0.264 | 0.301 | 0.089 | 0.000 | 0.542 | 1.657 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 27 | 27 | 24 | 17 | 0 | 16 | 22 | 19 | 14 | 14 |
| N.S. |
1 | 1.00 | 0.89 | 0.63 | 0.00 | 0.59 | 0.81 | 0.70 | 0.52 | 0.52 |
| time (sec) |
N/A | 0.003 | 0.003 | 0.020 | 0.000 | 0.298 | 0.091 | 0.000 | 0.192 | 1.686 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 20 | 20 | 0 | 19 | 0 | 19 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.71 | 0.71 | 0.00 | 0.68 | 0.00 | 0.68 | -0.04 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.003 | 0.024 | 0.000 | 0.314 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 20 | 21 | 0 | 20 | 0 | 21 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.62 | 0.66 | 0.00 | 0.62 | 0.00 | 0.66 | -0.03 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.004 | 0.020 | 0.000 | 0.308 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 26 | 26 | 22 | 19 | 0 | 18 | 29 | 25 | 28 | 19 |
| N.S. |
1 | 1.00 | 0.85 | 0.73 | 0.00 | 0.69 | 1.12 | 0.96 | 1.08 | 0.73 |
| time (sec) |
N/A | 0.003 | 0.003 | 0.020 | 0.000 | 0.306 | 0.202 | 0.001 | 0.144 | 1.739 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 37 | 37 | 24 | 21 | 33 | 24 | 29 | 26 | -1 | 19 |
| N.S. | 1 | 1.00 | 0.65 | 0.57 | 0.89 | 0.65 | 0.78 | 0.70 | -0.03 | 0.51 |
| time (sec) |
N/A | 0.009 | 0.004 | 0.028 | 0.283 | 0.299 | 0.259 | 0.001 | 0.000 | 1.864 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 37 | 37 | 24 | 21 | 31 | 24 | 29 | 26 | -1 | 19 |
| N.S. | 1 | 1.00 | 0.65 | 0.57 | 0.84 | 0.65 | 0.78 | 0.70 | -0.03 | 0.51 |
| time (sec) |
N/A | 0.009 | 0.004 | 0.025 | 0.275 | 0.296 | 0.224 | 0.001 | 0.000 | 1.833 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 37 | 37 | 24 | 21 | 28 | 24 | 29 | 26 | -1 | 19 |
| N.S. | 1 | 1.00 | 0.65 | 0.57 | 0.76 | 0.65 | 0.78 | 0.70 | -0.03 | 0.51 |
| time (sec) |
N/A | 0.008 | 0.004 | 0.023 | 0.269 | 0.304 | 0.195 | 0.001 | 0.000 | 1.791 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 37 | 37 | 22 | 19 | 25 | 24 | 27 | 26 | -1 | 18 |
| N.S. | 1 | 1.00 | 0.59 | 0.51 | 0.68 | 0.65 | 0.73 | 0.70 | -0.03 | 0.49 |
| time (sec) |
N/A | 0.007 | 0.004 | 0.023 | 0.256 | 0.301 | 0.165 | 0.000 | 0.000 | 1.760 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 37 | 37 | 25 | 18 | 22 | 24 | 24 | 26 | -1 | 16 |
| N.S. | 1 | 1.00 | 0.68 | 0.49 | 0.59 | 0.65 | 0.65 | 0.70 | -0.03 | 0.43 |
| time (sec) |
N/A | 0.007 | 0.002 | 0.024 | 0.266 | 0.313 | 0.167 | 0.001 | 0.000 | 1.745 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 23 | 21 | 0 | 22 | 24 | 26 | 20 | 19 |
| N.S. |
1 | 1.00 | 0.66 | 0.60 | 0.00 | 0.63 | 0.69 | 0.74 | 0.57 | 0.54 |
| time (sec) |
N/A | 0.006 | 0.002 | 0.021 | 0.000 | 0.296 | 0.173 | 0.000 | 0.267 | 1.755 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 21 | 20 | 0 | 18 | 26 | 20 | 14 | 17 |
| N.S. |
1 | 1.00 | 0.72 | 0.69 | 0.00 | 0.62 | 0.90 | 0.69 | 0.48 | 0.59 |
| time (sec) |
N/A | 0.003 | 0.002 | 0.020 | 0.000 | 0.299 | 0.243 | 0.000 | 0.222 | 1.780 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 21 | 20 | 0 | 21 | 0 | 20 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.67 | 0.00 | 0.70 | 0.00 | 0.67 | -0.03 | 0.00 |
| time (sec) |
N/A | 0.004 | 0.004 | 0.023 | 0.000 | 0.325 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 24 | 21 | 33 | 28 | 29 | 31 | -1 | 19 |
| N.S. | 1 | 1.00 | 0.59 | 0.51 | 0.80 | 0.68 | 0.71 | 0.76 | -0.02 | 0.46 |
| time (sec) |
N/A | 0.012 | 0.005 | 0.032 | 0.269 | 0.306 | 0.466 | 0.001 | 0.000 | 2.003 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 24 | 21 | 31 | 28 | 29 | 31 | -1 | 19 |
| N.S. | 1 | 1.00 | 0.59 | 0.51 | 0.76 | 0.68 | 0.71 | 0.76 | -0.02 | 0.46 |
| time (sec) |
N/A | 0.010 | 0.005 | 0.031 | 0.253 | 0.301 | 0.411 | 0.000 | 0.000 | 1.963 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 24 | 21 | 28 | 28 | 29 | 31 | -1 | 19 |
| N.S. | 1 | 1.00 | 0.59 | 0.51 | 0.68 | 0.68 | 0.71 | 0.76 | -0.02 | 0.46 |
| time (sec) |
N/A | 0.009 | 0.004 | 0.027 | 0.254 | 0.303 | 0.353 | 0.001 | 0.000 | 1.918 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 22 | 19 | 25 | 28 | 27 | 31 | -1 | 18 |
| N.S. | 1 | 1.00 | 0.54 | 0.46 | 0.61 | 0.68 | 0.66 | 0.76 | -0.02 | 0.44 |
| time (sec) |
N/A | 0.008 | 0.004 | 0.026 | 0.262 | 0.313 | 0.303 | 0.001 | 0.000 | 1.856 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 25 | 18 | 22 | 28 | 24 | 31 | -1 | 16 |
| N.S. | 1 | 1.00 | 0.61 | 0.44 | 0.54 | 0.68 | 0.59 | 0.76 | -0.02 | 0.39 |
| time (sec) |
N/A | 0.008 | 0.002 | 0.025 | 0.272 | 0.616 | 0.303 | 0.001 | 0.000 | 1.861 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 23 | 21 | 24 | 28 | 24 | 31 | 25 | 19 |
| N.S. | 1 | 1.00 | 0.56 | 0.51 | 0.59 | 0.68 | 0.59 | 0.76 | 0.61 | 0.46 |
| time (sec) |
N/A | 0.007 | 0.002 | 0.023 | 0.284 | 0.293 | 0.318 | 0.001 | 0.284 | 1.858 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 27 | 21 | 0 | 28 | 27 | 31 | 25 | 19 |
| N.S. |
1 | 1.00 | 0.66 | 0.51 | 0.00 | 0.68 | 0.66 | 0.76 | 0.61 | 0.46 |
| time (sec) |
N/A | 0.007 | 0.002 | 0.023 | 0.000 | 0.290 | 0.387 | 0.001 | 0.265 | 1.897 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 39 | 39 | 25 | 21 | 0 | 26 | 29 | 31 | 20 | 19 |
| N.S. |
1 | 1.00 | 0.64 | 0.54 | 0.00 | 0.67 | 0.74 | 0.79 | 0.51 | 0.49 |
| time (sec) |
N/A | 0.006 | 0.002 | 0.021 | 0.000 | 0.297 | 0.382 | 0.001 | 0.260 | 1.902 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 24 | 21 | 33 | 25 | 29 | 25 | -1 | 19 |
| N.S. | 1 | 1.00 | 0.69 | 0.60 | 0.94 | 0.71 | 0.83 | 0.71 | -0.03 | 0.54 |
| time (sec) |
N/A | 0.006 | 0.003 | 0.025 | 0.276 | 0.306 | 0.246 | 0.001 | 0.000 | 1.770 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 24 | 21 | 26 | 23 | 29 | 25 | 23 | 19 |
| N.S. | 1 | 1.00 | 0.69 | 0.60 | 0.74 | 0.66 | 0.83 | 0.71 | 0.66 | 0.54 |
| time (sec) |
N/A | 0.006 | 0.003 | 0.021 | 0.256 | 0.299 | 0.225 | 0.001 | 0.251 | 1.741 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 23 | 20 | 22 | 19 | 27 | 21 | 19 | 17 |
| N.S. | 1 | 1.00 | 0.72 | 0.62 | 0.69 | 0.59 | 0.84 | 0.66 | 0.59 | 0.53 |
| time (sec) |
N/A | 0.003 | 0.001 | 0.022 | 0.274 | 0.296 | 0.213 | 0.001 | 0.221 | 1.745 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 19 | 18 | 20 | 22 | 0 | 22 | 17 | 0 |
| N.S. |
1 | 1.00 | 0.66 | 0.62 | 0.69 | 0.76 | 0.00 | 0.76 | 0.59 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.002 | 0.030 | 0.265 | 0.299 | 0.000 | 0.001 | 0.513 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 27 | 27 | 23 | 18 | 17 | 23 | 0 | 24 | 22 | 0 |
| N.S. |
1 | 1.00 | 0.85 | 0.67 | 0.63 | 0.85 | 0.00 | 0.89 | 0.81 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.004 | 0.022 | 0.271 | 0.307 | 0.000 | 0.001 | 1.222 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 26 | 26 | 23 | 19 | 19 | 21 | 24 | 24 | 25 | 22 |
| N.S. | 1 | 1.00 | 0.88 | 0.73 | 0.73 | 0.81 | 0.92 | 0.92 | 0.96 | 0.85 |
| time (sec) |
N/A | 0.003 | 0.004 | 0.022 | 0.255 | 0.300 | 0.237 | 0.001 | 0.157 | 1.755 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 22 | 21 | 19 | 23 | 29 | 26 | 26 | 22 |
| N.S. | 1 | 1.00 | 0.63 | 0.60 | 0.54 | 0.66 | 0.83 | 0.74 | 0.74 | 0.63 |
| time (sec) |
N/A | 0.005 | 0.004 | 0.023 | 0.257 | 0.298 | 0.262 | 0.001 | 0.149 | 1.792 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 24 | 21 | 19 | 23 | 31 | 26 | 26 | 22 |
| N.S. | 1 | 1.00 | 0.69 | 0.60 | 0.54 | 0.66 | 0.89 | 0.74 | 0.74 | 0.63 |
| time (sec) |
N/A | 0.005 | 0.008 | 0.025 | 0.256 | 0.299 | 0.284 | 0.002 | 0.149 | 1.818 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 23 | 20 | 32 | 19 | 27 | 23 | -1 | 17 |
| N.S. | 1 | 1.00 | 0.61 | 0.53 | 0.84 | 0.50 | 0.71 | 0.61 | -0.03 | 0.45 |
| time (sec) |
N/A | 0.004 | 0.003 | 0.022 | 0.319 | 0.297 | 0.258 | 0.001 | 0.000 | 1.783 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 21 | 20 | 23 | 22 | 0 | 24 | 30 | 0 |
| N.S. |
1 | 1.00 | 0.60 | 0.57 | 0.66 | 0.63 | 0.00 | 0.69 | 0.86 | 0.00 |
| time (sec) |
N/A | 0.004 | 0.003 | 0.025 | 0.267 | 0.318 | 0.000 | 0.001 | 0.320 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 33 | 33 | 22 | 21 | 21 | 23 | 0 | 26 | 28 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 0.64 | 0.64 | 0.70 | 0.00 | 0.79 | 0.85 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.002 | 0.024 | 0.249 | 0.291 | 0.000 | 0.001 | 0.250 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 22 | 17 | 23 | 21 | 27 | 26 | 25 | 18 |
| N.S. | 1 | 1.00 | 0.76 | 0.59 | 0.79 | 0.72 | 0.93 | 0.90 | 0.86 | 0.62 |
| time (sec) |
N/A | 0.003 | 0.002 | 0.022 | 0.259 | 0.293 | 0.243 | 0.001 | 0.149 | 1.765 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 25 | 18 | 19 | 23 | 26 | 28 | 26 | 16 |
| N.S. | 1 | 1.00 | 0.61 | 0.44 | 0.46 | 0.56 | 0.63 | 0.68 | 0.63 | 0.39 |
| time (sec) |
N/A | 0.006 | 0.006 | 0.023 | 0.271 | 0.292 | 0.260 | 0.001 | 0.158 | 1.766 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 27 | 21 | 19 | 23 | 26 | 28 | 26 | 22 |
| N.S. | 1 | 1.00 | 0.66 | 0.51 | 0.46 | 0.56 | 0.63 | 0.68 | 0.63 | 0.54 |
| time (sec) |
N/A | 0.006 | 0.005 | 0.027 | 0.269 | 0.285 | 0.280 | 0.002 | 0.151 | 1.781 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 22 | 21 | 19 | 23 | 29 | 28 | 26 | 22 |
| N.S. | 1 | 1.00 | 0.54 | 0.51 | 0.46 | 0.56 | 0.71 | 0.68 | 0.63 | 0.54 |
| time (sec) |
N/A | 0.006 | 0.005 | 0.026 | 0.260 | 0.291 | 0.312 | 0.001 | 0.149 | 1.825 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 24 | 21 | 19 | 23 | 31 | 28 | 26 | 22 |
| N.S. | 1 | 1.00 | 0.59 | 0.51 | 0.46 | 0.56 | 0.76 | 0.68 | 0.63 | 0.54 |
| time (sec) |
N/A | 0.006 | 0.004 | 0.028 | 0.271 | 0.293 | 0.351 | 0.001 | 0.151 | 1.854 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 33 | 33 | 22 | 21 | 24 | 23 | 0 | 31 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 0.64 | 0.73 | 0.70 | 0.00 | 0.94 | -0.03 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.004 | 0.021 | 0.301 | 0.297 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 24 | 19 | 26 | 21 | 29 | 27 | 25 | 19 |
| N.S. | 1 | 1.00 | 0.83 | 0.66 | 0.90 | 0.72 | 1.00 | 0.93 | 0.86 | 0.66 |
| time (sec) |
N/A | 0.004 | 0.004 | 0.021 | 0.255 | 0.293 | 0.323 | 0.001 | 0.153 | 1.846 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 24 | 21 | 23 | 23 | 31 | 29 | 26 | 19 |
| N.S. | 1 | 1.00 | 0.59 | 0.51 | 0.56 | 0.56 | 0.76 | 0.71 | 0.63 | 0.46 |
| time (sec) |
N/A | 0.005 | 0.003 | 0.025 | 0.261 | 0.292 | 0.321 | 0.003 | 0.151 | 1.827 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 27 | 19 | 23 | 23 | 29 | 29 | 26 | 18 |
| N.S. | 1 | 1.00 | 0.66 | 0.46 | 0.56 | 0.56 | 0.71 | 0.71 | 0.63 | 0.44 |
| time (sec) |
N/A | 0.005 | 0.002 | 0.024 | 0.268 | 0.289 | 0.309 | 0.002 | 0.160 | 1.827 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 27 | 18 | 19 | 23 | 26 | 29 | 26 | 16 |
| N.S. | 1 | 1.00 | 0.66 | 0.44 | 0.46 | 0.56 | 0.63 | 0.71 | 0.63 | 0.39 |
| time (sec) |
N/A | 0.006 | 0.006 | 0.024 | 0.270 | 0.289 | 0.346 | 0.002 | 0.158 | 1.833 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 27 | 21 | 19 | 23 | 26 | 29 | 26 | 22 |
| N.S. | 1 | 1.00 | 0.66 | 0.51 | 0.46 | 0.56 | 0.63 | 0.71 | 0.63 | 0.54 |
| time (sec) |
N/A | 0.006 | 0.005 | 0.029 | 0.273 | 0.295 | 0.386 | 0.001 | 0.162 | 1.901 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 22 | 21 | 19 | 23 | 29 | 29 | 26 | 22 |
| N.S. | 1 | 1.00 | 0.54 | 0.51 | 0.46 | 0.56 | 0.71 | 0.71 | 0.63 | 0.54 |
| time (sec) |
N/A | 0.006 | 0.006 | 0.028 | 0.270 | 0.290 | 0.429 | 0.003 | 0.159 | 1.935 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 24 | 21 | 19 | 23 | 31 | 29 | 26 | 22 |
| N.S. | 1 | 1.00 | 0.59 | 0.51 | 0.46 | 0.56 | 0.76 | 0.71 | 0.63 | 0.54 |
| time (sec) |
N/A | 0.006 | 0.005 | 0.028 | 0.275 | 0.289 | 0.459 | 0.002 | 0.162 | 1.970 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 35 | 32 | 54 | 33 | 49 | 39 | -1 | 30 |
| N.S. | 1 | 1.00 | 0.61 | 0.56 | 0.95 | 0.58 | 0.86 | 0.68 | -0.02 | 0.53 |
| time (sec) |
N/A | 0.011 | 0.004 | 0.115 | 0.270 | 0.295 | 0.173 | 0.001 | 0.000 | 1.873 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 35 | 32 | 52 | 33 | 51 | 40 | -1 | 31 |
| N.S. | 1 | 1.00 | 0.61 | 0.56 | 0.91 | 0.58 | 0.89 | 0.70 | -0.02 | 0.54 |
| time (sec) |
N/A | 0.010 | 0.004 | 0.129 | 0.267 | 0.289 | 0.151 | 0.001 | 0.000 | 1.845 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 35 | 32 | 49 | 33 | 49 | 39 | -1 | 30 |
| N.S. | 1 | 1.00 | 0.61 | 0.56 | 0.86 | 0.58 | 0.86 | 0.68 | -0.02 | 0.53 |
| time (sec) |
N/A | 0.009 | 0.004 | 0.126 | 0.274 | 0.286 | 0.129 | 0.001 | 0.000 | 1.808 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 55 | 55 | 33 | 30 | 44 | 31 | 49 | 40 | -1 | 29 |
| N.S. | 1 | 1.00 | 0.60 | 0.55 | 0.80 | 0.56 | 0.89 | 0.73 | -0.02 | 0.53 |
| time (sec) |
N/A | 0.009 | 0.005 | 0.112 | 0.273 | 0.291 | 0.112 | 0.000 | 0.000 | 1.801 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | B | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 26 | 26 | 25 | 23 | 0 | 27 | 41 | 32 | -1 | 24 |
| N.S. |
1 | 1.00 | 0.96 | 0.88 | 0.00 | 1.04 | 1.58 | 1.23 | -0.04 | 0.92 |
| time (sec) |
N/A | 0.003 | 0.003 | 0.103 | 0.000 | 0.291 | 0.114 | 0.000 | 0.000 | 1.785 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 33 | 33 | 0 | 32 | 0 | 34 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 0.67 | 0.00 | 0.65 | 0.00 | 0.69 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.006 | 0.120 | 0.000 | 0.292 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 31 | 32 | 0 | 31 | 0 | 32 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.63 | 0.65 | 0.00 | 0.63 | 0.00 | 0.65 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.007 | 0.119 | 0.000 | 0.303 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 54 | 54 | 36 | 34 | 0 | 33 | 0 | 39 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 0.63 | 0.00 | 0.61 | 0.00 | 0.72 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.007 | 0.102 | 0.000 | 0.294 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 60 | 60 | 35 | 32 | 54 | 36 | 49 | 40 | -1 | 30 |
| N.S. | 1 | 1.00 | 0.58 | 0.53 | 0.90 | 0.60 | 0.82 | 0.67 | -0.02 | 0.50 |
| time (sec) |
N/A | 0.013 | 0.005 | 0.108 | 0.275 | 0.285 | 0.305 | 0.000 | 0.000 | 2.008 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 60 | 60 | 35 | 32 | 52 | 36 | 51 | 41 | -1 | 31 |
| N.S. | 1 | 1.00 | 0.58 | 0.53 | 0.87 | 0.60 | 0.85 | 0.68 | -0.02 | 0.52 |
| time (sec) |
N/A | 0.013 | 0.006 | 0.105 | 0.264 | 0.292 | 0.265 | 0.000 | 0.000 | 1.981 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 60 | 60 | 35 | 32 | 49 | 36 | 49 | 40 | -1 | 30 |
| N.S. | 1 | 1.00 | 0.58 | 0.53 | 0.82 | 0.60 | 0.82 | 0.67 | -0.02 | 0.50 |
| time (sec) |
N/A | 0.011 | 0.005 | 0.113 | 0.255 | 0.288 | 0.231 | 0.000 | 0.000 | 1.929 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 60 | 60 | 33 | 30 | 44 | 36 | 49 | 41 | -1 | 29 |
| N.S. | 1 | 1.00 | 0.55 | 0.50 | 0.73 | 0.60 | 0.82 | 0.68 | -0.02 | 0.48 |
| time (sec) |
N/A | 0.011 | 0.005 | 0.125 | 0.257 | 0.285 | 0.197 | 0.000 | 0.000 | 1.870 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 60 | 60 | 36 | 29 | 40 | 36 | 44 | 40 | -1 | 27 |
| N.S. | 1 | 1.00 | 0.60 | 0.48 | 0.67 | 0.60 | 0.73 | 0.67 | -0.02 | 0.45 |
| time (sec) |
N/A | 0.010 | 0.002 | 0.119 | 0.272 | 0.286 | 0.202 | 0.001 | 0.000 | 1.876 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 34 | 32 | 0 | 34 | 44 | 41 | -1 | 29 |
| N.S. |
1 | 1.00 | 0.59 | 0.55 | 0.00 | 0.59 | 0.76 | 0.71 | -0.02 | 0.50 |
| time (sec) |
N/A | 0.010 | 0.002 | 0.109 | 0.000 | 0.288 | 0.206 | 0.000 | 0.000 | 1.878 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | B | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 27 | 27 | 26 | 23 | 0 | 30 | 41 | 33 | -1 | 27 |
| N.S. |
1 | 1.00 | 0.96 | 0.85 | 0.00 | 1.11 | 1.52 | 1.22 | -0.04 | 1.00 |
| time (sec) |
N/A | 0.003 | 0.003 | 0.107 | 0.000 | 0.296 | 0.274 | 0.000 | 0.000 | 1.913 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 52 | 52 | 34 | 33 | 0 | 35 | 0 | 35 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.65 | 0.63 | 0.00 | 0.67 | 0.00 | 0.67 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.005 | 0.105 | 0.000 | 0.296 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 35 | 32 | 49 | 42 | 49 | 48 | -1 | 30 |
| N.S. | 1 | 1.00 | 0.53 | 0.48 | 0.74 | 0.64 | 0.74 | 0.73 | -0.02 | 0.45 |
| time (sec) |
N/A | 0.014 | 0.006 | 0.107 | 0.274 | 0.292 | 0.411 | 0.001 | 0.000 | 2.064 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 33 | 30 | 44 | 42 | 49 | 49 | -1 | 29 |
| N.S. | 1 | 1.00 | 0.50 | 0.45 | 0.67 | 0.64 | 0.74 | 0.74 | -0.02 | 0.44 |
| time (sec) |
N/A | 0.013 | 0.006 | 0.103 | 0.260 | 0.292 | 0.355 | 0.001 | 0.000 | 2.001 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 36 | 29 | 40 | 42 | 44 | 48 | -1 | 27 |
| N.S. | 1 | 1.00 | 0.55 | 0.44 | 0.61 | 0.64 | 0.67 | 0.73 | -0.02 | 0.41 |
| time (sec) |
N/A | 0.012 | 0.003 | 0.109 | 0.273 | 0.292 | 0.364 | 0.001 | 0.000 | 2.003 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 34 | 32 | 40 | 42 | 44 | 49 | -1 | 29 |
| N.S. | 1 | 1.00 | 0.52 | 0.48 | 0.61 | 0.64 | 0.67 | 0.74 | -0.02 | 0.44 |
| time (sec) |
N/A | 0.011 | 0.004 | 0.131 | 0.267 | 0.286 | 0.365 | 0.001 | 0.000 | 2.023 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 38 | 32 | 0 | 42 | 44 | 48 | -1 | 30 |
| N.S. |
1 | 1.00 | 0.58 | 0.48 | 0.00 | 0.64 | 0.67 | 0.73 | -0.02 | 0.45 |
| time (sec) |
N/A | 0.011 | 0.003 | 0.111 | 0.000 | 0.286 | 0.438 | 0.001 | 0.000 | 1.998 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 36 | 32 | 0 | 40 | 49 | 49 | -1 | 31 |
| N.S. |
1 | 1.00 | 0.56 | 0.50 | 0.00 | 0.62 | 0.77 | 0.77 | -0.02 | 0.48 |
| time (sec) |
N/A | 0.011 | 0.002 | 0.121 | 0.000 | 0.288 | 0.433 | 0.001 | 0.000 | 2.029 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | B | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 26 | 23 | 0 | 36 | 46 | 42 | -1 | 27 |
| N.S. |
1 | 1.00 | 0.90 | 0.79 | 0.00 | 1.24 | 1.59 | 1.45 | -0.03 | 0.93 |
| time (sec) |
N/A | 0.004 | 0.004 | 0.117 | 0.000 | 0.290 | 0.436 | 0.001 | 0.000 | 2.032 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 35 | 33 | 0 | 41 | 0 | 43 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.60 | 0.57 | 0.00 | 0.71 | 0.00 | 0.74 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.006 | 0.122 | 0.000 | 0.295 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 35 | 32 | 54 | 36 | 49 | 37 | -1 | 30 |
| N.S. | 1 | 1.00 | 0.61 | 0.56 | 0.95 | 0.63 | 0.86 | 0.65 | -0.02 | 0.53 |
| time (sec) |
N/A | 0.010 | 0.004 | 0.108 | 0.265 | 0.286 | 0.269 | 0.001 | 0.000 | 1.925 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 35 | 32 | 47 | 34 | 51 | 38 | -1 | 31 |
| N.S. | 1 | 1.00 | 0.61 | 0.56 | 0.82 | 0.60 | 0.89 | 0.67 | -0.02 | 0.54 |
| time (sec) |
N/A | 0.009 | 0.004 | 0.104 | 0.261 | 0.288 | 0.253 | 0.001 | 0.000 | 1.877 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | B | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 24 | 24 | 24 | 21 | 42 | 30 | 46 | 31 | -1 | 27 |
| N.S. | 1 | 1.00 | 1.00 | 0.88 | 1.75 | 1.25 | 1.92 | 1.29 | -0.04 | 1.12 |
| time (sec) |
N/A | 0.002 | 0.001 | 0.121 | 0.256 | 0.284 | 0.232 | 0.000 | 0.000 | 1.844 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 52 | 52 | 32 | 31 | 35 | 35 | 0 | 43 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.62 | 0.60 | 0.67 | 0.67 | 0.00 | 0.83 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.003 | 0.121 | 0.270 | 0.299 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 34 | 29 | 35 | 34 | 0 | 36 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 0.62 | 0.74 | 0.72 | 0.00 | 0.77 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.006 | 0.105 | 0.265 | 0.307 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 35 | 34 | 31 | 36 | 0 | 39 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.71 | 0.69 | 0.63 | 0.73 | 0.00 | 0.80 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.006 | 0.102 | 0.259 | 0.302 | 0.000 | 0.002 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 26 | 26 | 33 | 30 | 33 | 32 | 42 | 36 | 33 | 29 |
| N.S. | 1 | 1.00 | 1.27 | 1.15 | 1.27 | 1.23 | 1.62 | 1.38 | 1.27 | 1.12 |
| time (sec) |
N/A | 0.003 | 0.007 | 0.105 | 0.253 | 0.297 | 0.262 | 0.001 | 0.183 | 1.876 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 35 | 32 | 33 | 34 | 51 | 38 | 42 | 32 |
| N.S. | 1 | 1.00 | 0.61 | 0.56 | 0.58 | 0.60 | 0.89 | 0.67 | 0.74 | 0.56 |
| time (sec) |
N/A | 0.008 | 0.005 | 0.102 | 0.264 | 0.293 | 0.290 | 0.001 | 0.187 | 1.956 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | B | A | F | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 27 | 27 | 26 | 23 | 52 | 30 | 46 | 33 | -1 | 27 |
| N.S. | 1 | 1.00 | 0.96 | 0.85 | 1.93 | 1.11 | 1.70 | 1.22 | -0.04 | 1.00 |
| time (sec) |
N/A | 0.003 | 0.003 | 0.113 | 0.262 | 0.287 | 0.284 | 0.000 | 0.000 | 1.900 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 34 | 33 | 45 | 35 | 0 | 45 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.56 | 0.54 | 0.74 | 0.57 | 0.00 | 0.74 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.005 | 0.122 | 0.293 | 0.292 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 56 | 56 | 33 | 32 | 42 | 34 | 0 | 38 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.59 | 0.57 | 0.75 | 0.61 | 0.00 | 0.68 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.004 | 0.131 | 0.259 | 0.298 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 34 | 32 | 35 | 36 | 0 | 41 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.59 | 0.55 | 0.60 | 0.62 | 0.00 | 0.71 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.003 | 0.106 | 0.292 | 0.295 | 0.000 | 0.002 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 36 | 27 | 37 | 32 | 42 | 38 | 33 | 27 |
| N.S. | 1 | 1.00 | 1.24 | 0.93 | 1.28 | 1.10 | 1.45 | 1.31 | 1.14 | 0.93 |
| time (sec) |
N/A | 0.003 | 0.007 | 0.102 | 0.257 | 0.290 | 0.261 | 0.002 | 0.191 | 1.874 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 38 | 32 | 33 | 34 | 46 | 40 | 42 | 32 |
| N.S. | 1 | 1.00 | 0.58 | 0.48 | 0.50 | 0.52 | 0.70 | 0.61 | 0.64 | 0.48 |
| time (sec) |
N/A | 0.010 | 0.006 | 0.116 | 0.264 | 0.294 | 0.278 | 0.001 | 0.193 | 1.904 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 33 | 32 | 33 | 34 | 46 | 40 | 42 | 29 |
| N.S. | 1 | 1.00 | 0.50 | 0.48 | 0.50 | 0.52 | 0.70 | 0.61 | 0.64 | 0.44 |
| time (sec) |
N/A | 0.010 | 0.008 | 0.108 | 0.258 | 0.291 | 0.320 | 0.001 | 0.197 | 1.977 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 35 | 32 | 33 | 34 | 51 | 40 | 42 | 32 |
| N.S. | 1 | 1.00 | 0.53 | 0.48 | 0.50 | 0.52 | 0.77 | 0.61 | 0.64 | 0.48 |
| time (sec) |
N/A | 0.010 | 0.006 | 0.122 | 0.262 | 0.289 | 0.353 | 0.002 | 0.175 | 2.017 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 56 | 56 | 33 | 32 | 45 | 34 | 0 | 47 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.59 | 0.57 | 0.80 | 0.61 | 0.00 | 0.84 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.005 | 0.123 | 0.267 | 0.294 | 0.000 | 0.002 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 36 | 34 | 38 | 36 | 0 | 46 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.62 | 0.59 | 0.66 | 0.62 | 0.00 | 0.79 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.006 | 0.109 | 0.281 | 0.302 | 0.000 | 0.002 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 35 | 30 | 44 | 32 | 48 | 39 | 33 | 30 |
| N.S. | 1 | 1.00 | 1.21 | 1.03 | 1.52 | 1.10 | 1.66 | 1.34 | 1.14 | 1.03 |
| time (sec) |
N/A | 0.003 | 0.004 | 0.101 | 0.258 | 0.291 | 0.315 | 0.001 | 0.180 | 1.931 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 38 | 30 | 37 | 34 | 51 | 41 | 42 | 29 |
| N.S. | 1 | 1.00 | 0.58 | 0.45 | 0.56 | 0.52 | 0.77 | 0.62 | 0.64 | 0.44 |
| time (sec) |
N/A | 0.009 | 0.003 | 0.128 | 0.273 | 0.288 | 0.316 | 0.002 | 0.175 | 1.901 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 38 | 29 | 37 | 34 | 46 | 41 | 42 | 27 |
| N.S. | 1 | 1.00 | 0.58 | 0.44 | 0.56 | 0.52 | 0.70 | 0.62 | 0.64 | 0.41 |
| time (sec) |
N/A | 0.009 | 0.008 | 0.122 | 0.255 | 0.292 | 0.344 | 0.003 | 0.176 | 1.930 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 38 | 32 | 33 | 34 | 46 | 41 | 42 | 32 |
| N.S. | 1 | 1.00 | 0.58 | 0.48 | 0.50 | 0.52 | 0.70 | 0.62 | 0.64 | 0.48 |
| time (sec) |
N/A | 0.009 | 0.006 | 0.114 | 0.255 | 0.293 | 0.384 | 0.002 | 0.180 | 2.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 33 | 32 | 33 | 34 | 46 | 41 | 42 | 29 |
| N.S. | 1 | 1.00 | 0.50 | 0.48 | 0.50 | 0.52 | 0.70 | 0.62 | 0.64 | 0.44 |
| time (sec) |
N/A | 0.009 | 0.009 | 0.114 | 0.259 | 0.291 | 0.426 | 0.002 | 0.182 | 2.033 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 35 | 32 | 33 | 34 | 51 | 41 | 42 | 32 |
| N.S. | 1 | 1.00 | 0.53 | 0.48 | 0.50 | 0.52 | 0.77 | 0.62 | 0.64 | 0.48 |
| time (sec) |
N/A | 0.010 | 0.006 | 0.103 | 0.272 | 0.293 | 0.466 | 0.002 | 0.180 | 2.074 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 102 | 102 | 63 | 63 | 128 | 62 | 0 | 88 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.62 | 0.62 | 1.25 | 0.61 | 0.00 | 0.86 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.024 | 0.012 | 0.153 | 0.275 | 0.293 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 80 | 80 | 52 | 52 | 110 | 51 | 0 | 73 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.65 | 0.65 | 1.38 | 0.64 | 0.00 | 0.91 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.018 | 0.010 | 0.140 | 0.271 | 0.301 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 40 | 40 | 91 | 39 | 0 | 59 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.69 | 0.69 | 1.57 | 0.67 | 0.00 | 1.02 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.008 | 0.117 | 0.258 | 0.292 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 28 | 29 | 74 | 27 | 0 | 40 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.74 | 0.76 | 1.95 | 0.71 | 0.00 | 1.05 | -0.03 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.005 | 0.131 | 0.283 | 0.291 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 21 | 21 | 0 | 20 | 0 | 28 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.95 | 0.95 | 0.00 | 0.91 | 0.00 | 1.27 | -0.05 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.003 | 0.122 | 0.000 | 0.290 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 42 | 42 | 26 | 26 | 24 | 64 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.62 | 0.62 | 0.57 | 1.52 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.005 | 0.130 | 0.287 | 0.294 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 32 | 33 | 37 | 31 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.52 | 0.54 | 0.61 | 0.51 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.008 | 0.132 | 0.277 | 0.299 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 53 | 51 | 52 | 44 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.63 | 0.61 | 0.62 | 0.52 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 0.010 | 0.138 | 0.272 | 0.301 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 107 | 107 | 64 | 63 | 124 | 67 | 0 | 89 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.60 | 0.59 | 1.16 | 0.63 | 0.00 | 0.83 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.023 | 0.009 | 0.130 | 0.278 | 0.290 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 53 | 52 | 109 | 55 | 0 | 74 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.63 | 0.62 | 1.30 | 0.65 | 0.00 | 0.88 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 0.008 | 0.113 | 0.273 | 0.299 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 42 | 40 | 93 | 42 | 0 | 60 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.69 | 0.66 | 1.52 | 0.69 | 0.00 | 0.98 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.004 | 0.111 | 0.279 | 0.292 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 40 | 40 | 30 | 29 | 75 | 29 | 0 | 41 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.75 | 0.72 | 1.88 | 0.72 | 0.00 | 1.02 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.003 | 0.129 | 0.322 | 0.296 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 22 | 21 | 13 | 21 | 0 | 29 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.96 | 0.91 | 0.57 | 0.91 | 0.00 | 1.26 | -0.04 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.003 | 0.128 | 0.259 | 0.294 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 44 | 44 | 27 | 26 | 24 | 66 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.61 | 0.59 | 0.55 | 1.50 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.005 | 0.112 | 0.258 | 0.298 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 34 | 33 | 37 | 33 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.53 | 0.52 | 0.58 | 0.52 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.011 | 0.008 | 0.112 | 0.273 | 0.292 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 88 | 88 | 53 | 51 | 52 | 47 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.60 | 0.58 | 0.59 | 0.53 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 0.009 | 0.138 | 0.294 | 0.301 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 112 | 112 | 65 | 62 | 66 | 59 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.58 | 0.55 | 0.59 | 0.53 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.017 | 0.133 | 0.265 | 0.299 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 142 | 142 | 76 | 74 | 146 | 91 | 0 | 123 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.54 | 0.52 | 1.03 | 0.64 | 0.00 | 0.87 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.032 | 0.015 | 0.131 | 0.282 | 0.295 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 117 | 117 | 65 | 63 | 130 | 77 | 0 | 106 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.56 | 0.54 | 1.11 | 0.66 | 0.00 | 0.91 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.024 | 0.004 | 0.147 | 0.289 | 0.293 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 54 | 52 | 114 | 63 | 0 | 88 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.59 | 0.57 | 1.24 | 0.68 | 0.00 | 0.96 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.018 | 0.004 | 0.132 | 0.296 | 0.295 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 42 | 40 | 97 | 48 | 0 | 71 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.63 | 0.60 | 1.45 | 0.72 | 0.00 | 1.06 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.004 | 0.166 | 0.277 | 0.292 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 44 | 44 | 30 | 29 | 77 | 33 | 0 | 49 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 0.66 | 1.75 | 0.75 | 0.00 | 1.11 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.003 | 0.136 | 0.281 | 0.288 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 25 | 25 | 22 | 21 | 13 | 23 | 0 | 34 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.88 | 0.84 | 0.52 | 0.92 | 0.00 | 1.36 | -0.04 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.003 | 0.134 | 0.265 | 0.295 | 0.000 | 0.002 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 28 | 26 | 24 | 70 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.58 | 0.54 | 0.50 | 1.46 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.006 | 0.006 | 0.140 | 0.256 | 0.300 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 70 | 70 | 34 | 33 | 37 | 37 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.49 | 0.47 | 0.53 | 0.53 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.008 | 0.132 | 0.262 | 0.298 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 83 | 83 | 51 | 50 | 142 | 54 | 0 | 86 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.61 | 0.60 | 1.71 | 0.65 | 0.00 | 1.04 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 0.006 | 0.117 | 0.273 | 0.292 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 39 | 38 | 100 | 42 | 0 | 66 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.64 | 0.62 | 1.64 | 0.69 | 0.00 | 1.08 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.008 | 0.112 | 0.296 | 0.293 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 39 | 39 | 27 | 27 | 64 | 30 | 0 | 43 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.69 | 0.69 | 1.64 | 0.77 | 0.00 | 1.10 | -0.03 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.006 | 0.129 | 0.308 | 0.291 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 20 | 19 | 46 | 23 | 0 | 30 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.95 | 2.30 | 1.15 | 0.00 | 1.50 | -0.05 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.002 | 0.131 | 0.275 | 0.300 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 25 | 24 | 35 | 70 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.66 | 0.63 | 0.92 | 1.84 | 0.00 | 0.00 | -0.03 | 0.00 |
| time (sec) |
N/A | 0.004 | 0.003 | 0.112 | 0.272 | 0.303 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 54 | 54 | 36 | 30 | 37 | 34 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 0.56 | 0.69 | 0.63 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.010 | 0.007 | 0.132 | 0.272 | 0.291 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 77 | 77 | 52 | 51 | 55 | 47 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 0.66 | 0.71 | 0.61 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 0.007 | 0.138 | 0.278 | 0.300 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 63 | 62 | 69 | 58 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.63 | 0.62 | 0.69 | 0.58 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.020 | 0.008 | 0.135 | 0.268 | 0.296 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 95 | 95 | 53 | 52 | 162 | 54 | 0 | 88 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.56 | 0.55 | 1.71 | 0.57 | 0.00 | 0.93 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.020 | 0.007 | 0.133 | 0.307 | 0.293 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 70 | 70 | 41 | 40 | 140 | 42 | 0 | 68 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.59 | 0.57 | 2.00 | 0.60 | 0.00 | 0.97 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.006 | 0.133 | 0.303 | 0.290 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 29 | 29 | 116 | 30 | 0 | 45 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.64 | 0.64 | 2.58 | 0.67 | 0.00 | 1.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.005 | 0.139 | 0.284 | 0.293 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 22 | 21 | 74 | 23 | 0 | 32 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.96 | 0.91 | 3.22 | 1.00 | 0.00 | 1.39 | -0.04 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.003 | 0.129 | 0.290 | 0.290 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 44 | 44 | 27 | 26 | 35 | 70 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.61 | 0.59 | 0.80 | 1.59 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.005 | 0.131 | 0.267 | 0.299 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 63 | 63 | 35 | 33 | 51 | 34 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.56 | 0.52 | 0.81 | 0.54 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.005 | 0.114 | 0.274 | 0.296 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 89 | 89 | 51 | 49 | 65 | 47 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.57 | 0.55 | 0.73 | 0.53 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 0.005 | 0.112 | 0.268 | 0.300 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 115 | 115 | 66 | 59 | 69 | 58 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.57 | 0.51 | 0.60 | 0.50 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.010 | 0.140 | 0.271 | 0.296 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 106 | 106 | 81 | 88 | 135 | 83 | 0 | 101 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.76 | 0.83 | 1.27 | 0.78 | 0.00 | 0.95 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.031 | 0.017 | 0.135 | 0.282 | 0.297 | 0.000 | 0.002 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 85 | 85 | 70 | 76 | 118 | 72 | 0 | 87 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.82 | 0.89 | 1.39 | 0.85 | 0.00 | 1.02 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.024 | 0.015 | 0.115 | 0.291 | 0.298 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 53 | 62 | 96 | 57 | 0 | 64 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.82 | 0.95 | 1.48 | 0.88 | 0.00 | 0.98 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.017 | 0.013 | 0.118 | 0.267 | 0.315 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 36 | 41 | 79 | 38 | 0 | 48 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.77 | 0.87 | 1.68 | 0.81 | 0.00 | 1.02 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.009 | 0.135 | 0.269 | 0.299 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 24 | 24 | 23 | 23 | 16 | 23 | 32 | 26 | 22 | 39 |
| N.S. | 1 | 1.00 | 0.96 | 0.96 | 0.67 | 0.96 | 1.33 | 1.08 | 0.92 | 1.62 |
| time (sec) |
N/A | 0.003 | 0.004 | 0.122 | 0.268 | 0.287 | 0.319 | 0.001 | 0.165 | 1.846 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 45 | 52 | 38 | 42 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.69 | 0.80 | 0.58 | 0.65 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.015 | 0.011 | 0.115 | 0.266 | 0.296 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 87 | 87 | 57 | 74 | 58 | 60 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.66 | 0.85 | 0.67 | 0.69 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.018 | 0.113 | 0.272 | 0.295 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 112 | 112 | 82 | 95 | 79 | 77 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.73 | 0.85 | 0.71 | 0.69 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.027 | 0.015 | 0.131 | 0.255 | 0.301 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 111 | 111 | 82 | 88 | 132 | 91 | 0 | 102 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.74 | 0.79 | 1.19 | 0.82 | 0.00 | 0.92 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.027 | 0.014 | 0.155 | 0.273 | 0.298 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 89 | 89 | 71 | 76 | 115 | 79 | 0 | 88 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.80 | 0.85 | 1.29 | 0.89 | 0.00 | 0.99 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.011 | 0.135 | 0.270 | 0.309 | 0.000 | 0.002 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 55 | 62 | 98 | 63 | 0 | 65 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.81 | 0.91 | 1.44 | 0.93 | 0.00 | 0.96 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 0.005 | 0.121 | 0.285 | 0.299 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 38 | 41 | 80 | 43 | 0 | 49 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.78 | 0.84 | 1.63 | 0.88 | 0.00 | 1.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.010 | 0.003 | 0.130 | 0.275 | 0.297 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 25 | 25 | 24 | 23 | 16 | 24 | 37 | 27 | 24 | 42 |
| N.S. | 1 | 1.00 | 0.96 | 0.92 | 0.64 | 0.96 | 1.48 | 1.08 | 0.96 | 1.68 |
| time (sec) |
N/A | 0.003 | 0.004 | 0.115 | 0.273 | 0.293 | 0.638 | 0.001 | 0.148 | 2.232 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 46 | 52 | 38 | 47 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 0.76 | 0.56 | 0.69 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.010 | 0.125 | 0.260 | 0.293 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 91 | 91 | 59 | 74 | 58 | 65 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.65 | 0.81 | 0.64 | 0.71 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.018 | 0.015 | 0.132 | 0.269 | 0.304 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 117 | 117 | 82 | 95 | 79 | 82 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.81 | 0.68 | 0.70 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.014 | 0.137 | 0.270 | 0.297 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 107 | 107 | 80 | 86 | 168 | 85 | 0 | 114 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.75 | 0.80 | 1.57 | 0.79 | 0.00 | 1.07 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.023 | 0.010 | 0.115 | 0.295 | 0.293 | 0.000 | 0.002 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 86 | 86 | 69 | 74 | 129 | 74 | 0 | 94 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.80 | 0.86 | 1.50 | 0.86 | 0.00 | 1.09 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.019 | 0.008 | 0.122 | 0.271 | 0.296 | 0.000 | 0.002 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 52 | 60 | 88 | 59 | 0 | 67 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.81 | 0.94 | 1.38 | 0.92 | 0.00 | 1.05 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.008 | 0.138 | 0.276 | 0.298 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 35 | 39 | 68 | 40 | 0 | 50 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.81 | 0.91 | 1.58 | 0.93 | 0.00 | 1.16 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.010 | 0.006 | 0.130 | 0.259 | 0.294 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 22 | 21 | 21 | 25 | 68 | 26 | 25 | 83 |
| N.S. | 1 | 1.00 | 1.00 | 0.95 | 0.95 | 1.14 | 3.09 | 1.18 | 1.14 | 3.77 |
| time (sec) |
N/A | 0.003 | 0.002 | 0.121 | 0.292 | 0.287 | 0.441 | 0.001 | 0.156 | 2.079 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 59 | 59 | 44 | 50 | 61 | 44 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.75 | 0.85 | 1.03 | 0.75 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.004 | 0.132 | 0.275 | 0.314 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 78 | 78 | 60 | 71 | 57 | 62 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.77 | 0.91 | 0.73 | 0.79 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 0.014 | 0.114 | 0.256 | 0.296 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 103 | 103 | 81 | 95 | 76 | 79 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.79 | 0.92 | 0.74 | 0.77 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.012 | 0.143 | 0.268 | 0.299 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 73 | 73 | 54 | 62 | 149 | 63 | 0 | 69 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.74 | 0.85 | 2.04 | 0.86 | 0.00 | 0.95 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 0.010 | 0.130 | 0.287 | 0.294 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 37 | 41 | 108 | 44 | 0 | 52 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.76 | 0.84 | 2.20 | 0.90 | 0.00 | 1.06 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.011 | 0.008 | 0.140 | 0.285 | 0.291 | 0.000 | 0.001 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 25 | 25 | 24 | 23 | 47 | 29 | 73 | 28 | 25 | 89 |
| N.S. | 1 | 1.00 | 0.96 | 0.92 | 1.88 | 1.16 | 2.92 | 1.12 | 1.00 | 3.56 |
| time (sec) |
N/A | 0.003 | 0.004 | 0.137 | 0.283 | 0.286 | 0.569 | 0.001 | 0.167 | 2.219 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 46 | 52 | 82 | 48 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 0.76 | 1.21 | 0.71 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.009 | 0.116 | 0.275 | 0.294 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 90 | 90 | 59 | 74 | 79 | 66 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.66 | 0.82 | 0.88 | 0.73 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.018 | 0.007 | 0.126 | 0.273 | 0.300 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 118 | 118 | 80 | 93 | 98 | 83 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 0.79 | 0.83 | 0.70 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.023 | 0.006 | 0.135 | 0.273 | 0.301 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | B | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 131 | 131 | 97 | 136 | 116 | 153 | 0 | 327 | 214 | 0 |
| N.S. |
1 | 1.00 | 0.74 | 1.04 | 0.89 | 1.17 | 0.00 | 2.50 | 1.63 | 0.00 |
| time (sec) |
N/A | 0.026 | 0.043 | 0.130 | 0.280 | 0.304 | 0.000 | 0.004 | 0.348 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | B | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 96 | 96 | 68 | 83 | 80 | 106 | 0 | 216 | 142 | 0 |
| N.S. |
1 | 1.00 | 0.71 | 0.86 | 0.83 | 1.10 | 0.00 | 2.25 | 1.48 | 0.00 |
| time (sec) |
N/A | 0.020 | 0.031 | 0.112 | 0.261 | 0.300 | 0.000 | 0.003 | 0.252 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | B | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 63 | 63 | 44 | 46 | 51 | 63 | 0 | 129 | 85 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.73 | 0.81 | 1.00 | 0.00 | 2.05 | 1.35 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.021 | 0.120 | 0.274 | 0.300 | 0.000 | 0.002 | 0.222 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 29 | 29 | 28 | 30 | 0 | 40 | 31 | 0 |
| N.S. |
1 | 1.00 | 0.97 | 0.97 | 0.93 | 1.00 | 0.00 | 1.33 | 1.03 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.010 | 0.130 | 0.263 | 0.297 | 0.000 | 0.002 | 0.228 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 46 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.98 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.009 | 0.033 | 0.000 | 0.299 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 47 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.010 | 0.026 | 0.000 | 0.303 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 50 | 50 | 50 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.012 | 0.026 | 0.000 | 0.305 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 169 | 169 | 132 | 199 | 157 | 233 | 0 | 464 | 307 | 0 |
| N.S. |
1 | 1.00 | 0.78 | 1.18 | 0.93 | 1.38 | 0.00 | 2.75 | 1.82 | 0.00 |
| time (sec) |
N/A | 0.041 | 0.067 | 0.132 | 0.260 | 0.307 | 0.000 | 0.004 | 0.414 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | B | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 135 | 135 | 98 | 136 | 116 | 164 | 0 | 328 | 219 | 0 |
| N.S. |
1 | 1.00 | 0.73 | 1.01 | 0.86 | 1.21 | 0.00 | 2.43 | 1.62 | 0.00 |
| time (sec) |
N/A | 0.031 | 0.033 | 0.140 | 0.271 | 0.305 | 0.000 | 0.004 | 0.320 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 99 | 99 | 70 | 83 | 80 | 113 | 0 | 0 | 146 | 0 |
| N.S. |
1 | 1.00 | 0.71 | 0.84 | 0.81 | 1.14 | 0.00 | 0.00 | 1.47 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.019 | 0.135 | 0.284 | 0.296 | 0.000 | 0.000 | 0.261 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 46 | 46 | 51 | 68 | 0 | 130 | 88 | 0 |
| N.S. |
1 | 1.00 | 0.71 | 0.71 | 0.78 | 1.05 | 0.00 | 2.00 | 1.35 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.007 | 0.114 | 0.271 | 0.298 | 0.000 | 0.002 | 0.231 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 31 | 31 | 30 | 29 | 28 | 33 | 0 | 41 | 45 | 0 |
| N.S. |
1 | 1.00 | 0.97 | 0.94 | 0.90 | 1.06 | 0.00 | 1.32 | 1.45 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.011 | 0.124 | 0.286 | 0.305 | 0.000 | 0.002 | 0.229 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 47 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.98 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.008 | 0.026 | 0.000 | 0.305 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 47 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.98 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.008 | 0.027 | 0.000 | 0.313 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 50 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.98 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.010 | 0.009 | 0.026 | 0.000 | 0.305 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 217 | 217 | 172 | 280 | 203 | 352 | 0 | 693 | 424 | 0 |
| N.S. |
1 | 1.00 | 0.79 | 1.29 | 0.94 | 1.62 | 0.00 | 3.19 | 1.95 | 0.00 |
| time (sec) |
N/A | 0.054 | 0.085 | 0.145 | 0.291 | 0.304 | 0.000 | 0.006 | 0.496 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 179 | 179 | 133 | 199 | 157 | 265 | 0 | 0 | 319 | 0 |
| N.S. |
1 | 1.00 | 0.74 | 1.11 | 0.88 | 1.48 | 0.00 | 0.00 | 1.78 | 0.00 |
| time (sec) |
N/A | 0.039 | 0.015 | 0.137 | 0.272 | 0.306 | 0.000 | 0.000 | 0.379 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 143 | 143 | 99 | 136 | 116 | 186 | 0 | 0 | 229 | 0 |
| N.S. |
1 | 1.00 | 0.69 | 0.95 | 0.81 | 1.30 | 0.00 | 0.00 | 1.60 | 0.00 |
| time (sec) |
N/A | 0.030 | 0.012 | 0.137 | 0.268 | 0.298 | 0.000 | 0.000 | 0.317 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 105 | 105 | 70 | 83 | 80 | 127 | 0 | 0 | 154 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 0.79 | 0.76 | 1.21 | 0.00 | 0.00 | 1.47 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.029 | 0.118 | 0.264 | 0.302 | 0.000 | 0.000 | 0.265 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 69 | 69 | 46 | 46 | 51 | 76 | 0 | 0 | 94 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 0.67 | 0.74 | 1.10 | 0.00 | 0.00 | 1.36 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.007 | 0.156 | 0.263 | 0.302 | 0.000 | 0.000 | 0.239 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 33 | 33 | 31 | 29 | 28 | 37 | 0 | 0 | 49 | 0 |
| N.S. |
1 | 1.00 | 0.94 | 0.88 | 0.85 | 1.12 | 0.00 | 0.00 | 1.48 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.012 | 0.118 | 0.270 | 0.299 | 0.000 | 0.000 | 0.231 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 50 | 50 | 47 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.94 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.009 | 0.029 | 0.000 | 0.298 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 50 | 50 | 47 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.94 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.008 | 0.031 | 0.000 | 0.315 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 123 | 123 | 96 | 134 | 104 | 158 | 0 | 0 | 186 | 0 |
| N.S. |
1 | 1.00 | 0.78 | 1.09 | 0.85 | 1.28 | 0.00 | 0.00 | 1.51 | 0.00 |
| time (sec) |
N/A | 0.025 | 0.023 | 0.143 | 0.263 | 0.312 | 0.000 | 0.000 | 0.369 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 90 | 90 | 67 | 81 | 83 | 110 | 0 | 0 | 121 | 0 |
| N.S. |
1 | 1.00 | 0.74 | 0.90 | 0.92 | 1.22 | 0.00 | 0.00 | 1.34 | 0.00 |
| time (sec) |
N/A | 0.017 | 0.018 | 0.135 | 0.269 | 0.300 | 0.000 | 0.000 | 0.295 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 59 | 59 | 43 | 44 | 45 | 66 | 0 | 0 | 71 | 0 |
| N.S. |
1 | 1.00 | 0.73 | 0.75 | 0.76 | 1.12 | 0.00 | 0.00 | 1.20 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.014 | 0.136 | 0.273 | 0.303 | 0.000 | 0.000 | 0.277 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 28 | 27 | 31 | 33 | 0 | 0 | 36 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.96 | 1.11 | 1.18 | 0.00 | 0.00 | 1.29 | 0.00 |
| time (sec) |
N/A | 0.004 | 0.006 | 0.134 | 0.268 | 0.299 | 0.000 | 0.000 | 0.220 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 45 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.003 | 0.027 | 0.000 | 0.311 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 48 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.07 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.008 | 0.029 | 0.000 | 0.309 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 51 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.06 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.009 | 0.030 | 0.000 | 0.303 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 135 | 135 | 98 | 136 | 104 | 168 | 0 | 0 | 201 | 0 |
| N.S. |
1 | 1.00 | 0.73 | 1.01 | 0.77 | 1.24 | 0.00 | 0.00 | 1.49 | 0.00 |
| time (sec) |
N/A | 0.030 | 0.027 | 0.137 | 0.261 | 0.303 | 0.000 | 0.000 | 0.404 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 99 | 99 | 69 | 83 | 83 | 118 | 0 | 0 | 133 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.84 | 0.84 | 1.19 | 0.00 | 0.00 | 1.34 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.022 | 0.131 | 0.275 | 0.296 | 0.000 | 0.000 | 0.313 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 45 | 46 | 45 | 72 | 0 | 0 | 80 | 0 |
| N.S. |
1 | 1.00 | 0.69 | 0.71 | 0.69 | 1.11 | 0.00 | 0.00 | 1.23 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.016 | 0.134 | 0.261 | 0.301 | 0.000 | 0.000 | 0.289 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 31 | 31 | 30 | 29 | 31 | 37 | 0 | 0 | 42 | 0 |
| N.S. |
1 | 1.00 | 0.97 | 0.94 | 1.00 | 1.19 | 0.00 | 0.00 | 1.35 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.010 | 0.138 | 0.261 | 0.301 | 0.000 | 0.000 | 0.229 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 47 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.98 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.006 | 0.029 | 0.000 | 0.298 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 47 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.98 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.005 | 0.027 | 0.000 | 0.302 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 50 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.98 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.010 | 0.003 | 0.024 | 0.000 | 0.301 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 50 | 50 | 50 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.010 | 0.026 | 0.026 | 0.000 | 0.320 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 135 | 135 | 99 | 136 | 104 | 168 | 0 | 0 | 201 | 0 |
| N.S. |
1 | 1.00 | 0.73 | 1.01 | 0.77 | 1.24 | 0.00 | 0.00 | 1.49 | 0.00 |
| time (sec) |
N/A | 0.030 | 0.024 | 0.118 | 0.270 | 0.304 | 0.000 | 0.000 | 0.410 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 99 | 99 | 70 | 83 | 83 | 118 | 0 | 0 | 133 | 0 |
| N.S. |
1 | 1.00 | 0.71 | 0.84 | 0.84 | 1.19 | 0.00 | 0.00 | 1.34 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.020 | 0.145 | 0.261 | 0.300 | 0.000 | 0.000 | 0.355 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 46 | 46 | 45 | 72 | 0 | 0 | 80 | 0 |
| N.S. |
1 | 1.00 | 0.71 | 0.71 | 0.69 | 1.11 | 0.00 | 0.00 | 1.23 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.014 | 0.137 | 0.273 | 0.303 | 0.000 | 0.000 | 0.285 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 31 | 31 | 31 | 29 | 31 | 37 | 0 | 0 | 42 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.94 | 1.00 | 1.19 | 0.00 | 0.00 | 1.35 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.009 | 0.128 | 0.267 | 0.302 | 0.000 | 0.000 | 0.230 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 47 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.98 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.007 | 0.028 | 0.000 | 0.299 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 47 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.98 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.007 | 0.026 | 0.000 | 0.305 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 50 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.98 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.010 | 0.007 | 0.027 | 0.000 | 0.306 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 50 | 50 | 49 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.98 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.010 | 0.003 | 0.024 | 0.000 | 0.298 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 38 | 40 | 39 | 58 | 0 | 0 | 44 | 0 |
| N.S. |
1 | 1.00 | 0.58 | 0.62 | 0.60 | 0.89 | 0.00 | 0.00 | 0.68 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.032 | 0.013 | 0.280 | 0.310 | 0.000 | 0.000 | 0.266 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 38 | 40 | 39 | 50 | 0 | 0 | 42 | 0 |
| N.S. |
1 | 1.00 | 0.62 | 0.66 | 0.64 | 0.82 | 0.00 | 0.00 | 0.69 | 0.00 |
| time (sec) |
N/A | 0.019 | 0.029 | 0.011 | 0.300 | 0.300 | 0.000 | 0.000 | 0.237 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 59 | 59 | 38 | 40 | 39 | 44 | 0 | 0 | 39 | 0 |
| N.S. |
1 | 1.00 | 0.64 | 0.68 | 0.66 | 0.75 | 0.00 | 0.00 | 0.66 | 0.00 |
| time (sec) |
N/A | 0.018 | 0.027 | 0.011 | 0.284 | 0.299 | 0.000 | 0.000 | 0.212 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 33 | 32 | 32 | 36 | 0 | 0 | 30 | 0 |
| N.S. |
1 | 1.00 | 0.69 | 0.67 | 0.67 | 0.75 | 0.00 | 0.00 | 0.62 | 0.00 |
| time (sec) |
N/A | 0.015 | 0.024 | 0.012 | 0.273 | 0.301 | 0.000 | 0.000 | 0.211 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 38 | 40 | 39 | 53 | 0 | 0 | 48 | 0 |
| N.S. |
1 | 1.00 | 0.58 | 0.62 | 0.60 | 0.82 | 0.00 | 0.00 | 0.74 | 0.00 |
| time (sec) |
N/A | 0.026 | 0.031 | 0.015 | 0.298 | 0.302 | 0.000 | 0.000 | 0.259 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 38 | 40 | 39 | 53 | 0 | 0 | 47 | 0 |
| N.S. |
1 | 1.00 | 0.57 | 0.60 | 0.58 | 0.79 | 0.00 | 0.00 | 0.70 | 0.00 |
| time (sec) |
N/A | 0.025 | 0.032 | 0.014 | 0.274 | 0.301 | 0.000 | 0.000 | 0.275 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 103 | 103 | 48 | 95 | 64 | 123 | 0 | 0 | 127 | 0 |
| N.S. |
1 | 1.00 | 0.47 | 0.92 | 0.62 | 1.19 | 0.00 | 0.00 | 1.23 | 0.00 |
| time (sec) |
N/A | 0.035 | 0.054 | 0.105 | 0.275 | 0.301 | 0.000 | 0.000 | 0.312 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 97 | 97 | 48 | 95 | 64 | 105 | 0 | 0 | 121 | 0 |
| N.S. |
1 | 1.00 | 0.49 | 0.98 | 0.66 | 1.08 | 0.00 | 0.00 | 1.25 | 0.00 |
| time (sec) |
N/A | 0.032 | 0.049 | 0.108 | 0.273 | 0.307 | 0.000 | 0.000 | 0.279 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 94 | 94 | 72 | 95 | 64 | 94 | 0 | 0 | 116 | 0 |
| N.S. |
1 | 1.00 | 0.77 | 1.01 | 0.68 | 1.00 | 0.00 | 0.00 | 1.23 | 0.00 |
| time (sec) |
N/A | 0.030 | 0.047 | 0.117 | 0.274 | 0.302 | 0.000 | 0.000 | 0.264 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 62 | 79 | 57 | 85 | 0 | 0 | 62 | 0 |
| N.S. |
1 | 1.00 | 0.77 | 0.98 | 0.70 | 1.05 | 0.00 | 0.00 | 0.77 | 0.00 |
| time (sec) |
N/A | 0.026 | 0.043 | 0.131 | 0.287 | 0.301 | 0.000 | 0.000 | 0.258 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 93 | 93 | 62 | 83 | 59 | 92 | 0 | 0 | 66 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 0.89 | 0.63 | 0.99 | 0.00 | 0.00 | 0.71 | 0.00 |
| time (sec) |
N/A | 0.033 | 0.045 | 0.120 | 0.271 | 0.302 | 0.000 | 0.000 | 0.319 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 105 | 105 | 72 | 95 | 64 | 106 | 0 | 0 | 82 | 0 |
| N.S. |
1 | 1.00 | 0.69 | 0.90 | 0.61 | 1.01 | 0.00 | 0.00 | 0.78 | 0.00 |
| time (sec) |
N/A | 0.038 | 0.049 | 0.112 | 0.280 | 0.308 | 0.000 | 0.000 | 0.339 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 57 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.85 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.028 | 0.034 | 0.000 | 0.307 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 57 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.88 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.026 | 0.033 | 0.000 | 0.308 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 57 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.89 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.020 | 0.024 | 0.036 | 0.000 | 0.308 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 53 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.017 | 0.023 | 0.036 | 0.000 | 0.305 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 57 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.84 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.026 | 0.037 | 0.000 | 0.309 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 57 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.84 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.029 | 0.035 | 0.000 | 0.304 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-2) | B | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 33 | 33 | 32 | 32 | 0 | 40 | 0 | 81 | 33 | 0 |
| N.S. |
1 | 1.00 | 0.97 | 0.97 | 0.00 | 1.21 | 0.00 | 2.45 | 1.00 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.041 | 0.142 | 0.000 | 0.308 | 0.000 | 0.009 | 0.266 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 34 | 33 | 0 | 40 | 0 | 0 | 34 | 0 |
| N.S. |
1 | 1.00 | 1.06 | 1.03 | 0.00 | 1.25 | 0.00 | 0.00 | 1.06 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.044 | 0.145 | 0.000 | 0.304 | 0.000 | 0.000 | 0.235 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 33 | 33 | 32 | 32 | 0 | 38 | 1409 | 81 | 33 | 1406 |
| N.S. | 1 | 1.00 | 0.97 | 0.97 | 0.00 | 1.15 | 42.70 | 2.45 | 1.00 | 42.61 |
| time (sec) |
N/A | 0.008 | 0.035 | 0.142 | 0.000 | 0.304 | 147.575 | 0.008 | 0.217 | 141.623 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 28 | 31 | 0 | 36 | 0 | 0 | 32 | 0 |
| N.S. |
1 | 1.00 | 0.93 | 1.03 | 0.00 | 1.20 | 0.00 | 0.00 | 1.07 | 0.00 |
| time (sec) |
N/A | 0.006 | 0.035 | 0.129 | 0.000 | 0.300 | 0.000 | 0.000 | 0.200 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | F | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 26 | 26 | 26 | 25 | 27 | 31 | 250 | 0 | 26 | 284 |
| N.S. | 1 | 1.00 | 1.00 | 0.96 | 1.04 | 1.19 | 9.62 | 0.00 | 1.00 | 10.92 |
| time (sec) |
N/A | 0.004 | 0.031 | 0.125 | 0.265 | 0.310 | 18.541 | 0.000 | 0.262 | 19.399 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 33 | 33 | 32 | 38 | 0 | 37 | 0 | 0 | 32 | 0 |
| N.S. |
1 | 1.00 | 0.97 | 1.15 | 0.00 | 1.12 | 0.00 | 0.00 | 0.97 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.026 | 0.148 | 0.000 | 0.305 | 0.000 | 0.000 | 0.240 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 32 | 32 | 0 | 37 | 0 | 0 | 50 | 0 |
| N.S. |
1 | 1.00 | 0.91 | 0.91 | 0.00 | 1.06 | 0.00 | 0.00 | 1.43 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.029 | 0.149 | 0.000 | 0.301 | 0.000 | 0.000 | 0.248 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 33 | 33 | 32 | 33 | 0 | 37 | 0 | 0 | 51 | 0 |
| N.S. |
1 | 1.00 | 0.97 | 1.00 | 0.00 | 1.12 | 0.00 | 0.00 | 1.55 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.032 | 0.187 | 0.000 | 0.303 | 0.000 | 0.000 | 0.251 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-1) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 38 | 39 | 0 | 49 | 0 | 0 | 50 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 1.03 | 0.00 | 1.29 | 0.00 | 0.00 | 1.32 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.049 | 0.161 | 0.000 | 0.308 | 0.000 | 0.000 | 0.338 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-1) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 39 | 39 | 39 | 40 | 0 | 57 | 0 | 0 | 39 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 1.03 | 0.00 | 1.46 | 0.00 | 0.00 | 1.00 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.012 | 0.209 | 0.000 | 0.309 | 0.000 | 0.000 | 0.265 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 63 | 63 | 63 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.026 | 0.059 | 0.000 | 0.305 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 64 | 64 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 0.94 | 0.94 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 0.007 | 0.049 | 0.000 | 0.308 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 16 | 31 | 31 | 34 | 32 | 27 | 27 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 1.82 | 1.82 | 2.00 | 1.88 | 1.59 | 1.59 |
| time (sec) |
N/A | 0.003 | 0.001 | 0.134 | 0.260 | 0.291 | 0.057 | 0.001 | 0.050 | 1.660 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 19 | 18 | 20 | 20 | 20 | 22 | 16 | 16 |
| N.S. | 1 | 1.00 | 0.83 | 0.78 | 0.87 | 0.87 | 0.87 | 0.96 | 0.70 | 0.70 |
| time (sec) |
N/A | 0.004 | 0.001 | 0.135 | 0.256 | 0.288 | 0.052 | 0.001 | 0.034 | 1.612 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 8 | 8 | 8 | 9 | 8 | 8 | 7 | 9 | 8 | 8 |
| N.S. | 1 | 1.00 | 1.00 | 1.12 | 1.00 | 1.00 | 0.88 | 1.12 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.001 | 0.000 | 0.149 | 0.248 | 0.288 | 0.048 | 0.001 | 0.010 | 1.538 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 13 | 13 | 13 | 14 | 13 | 13 | 19 | 17 | 13 | 17 |
| N.S. | 1 | 1.00 | 1.00 | 1.08 | 1.00 | 1.00 | 1.46 | 1.31 | 1.00 | 1.31 |
| time (sec) |
N/A | 0.002 | 0.002 | 0.149 | 0.271 | 0.298 | 0.050 | 0.001 | 0.048 | 1.628 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 15 | 16 | 19 | 19 | 19 | 15 | 15 | 15 |
| N.S. | 1 | 1.00 | 1.00 | 1.07 | 1.27 | 1.27 | 1.27 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.002 | 0.003 | 0.128 | 0.261 | 0.291 | 0.082 | 0.001 | 0.037 | 1.669 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 16 | 47 | 47 | 53 | 18 | 49 | 37 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 2.76 | 2.76 | 3.12 | 1.06 | 2.88 | 2.18 |
| time (sec) |
N/A | 0.002 | 0.003 | 0.146 | 0.257 | 0.289 | 0.142 | 0.001 | 0.153 | 1.941 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 16 | 61 | 61 | 68 | 18 | 63 | 48 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 3.59 | 3.59 | 4.00 | 1.06 | 3.71 | 2.82 |
| time (sec) |
N/A | 0.002 | 0.004 | 0.143 | 0.255 | 0.295 | 0.174 | 0.001 | 0.064 | 2.068 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 16 | 75 | 75 | 83 | 18 | 77 | 59 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 4.41 | 4.41 | 4.88 | 1.06 | 4.53 | 3.47 |
| time (sec) |
N/A | 0.002 | 0.004 | 0.137 | 0.257 | 0.291 | 0.208 | 0.001 | 0.054 | 2.222 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 16 | 35 | 35 | 34 | 36 | 27 | 27 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 2.06 | 2.06 | 2.00 | 2.12 | 1.59 | 1.59 |
| time (sec) |
N/A | 0.003 | 0.002 | 0.153 | 0.266 | 0.287 | 0.060 | 0.001 | 0.156 | 1.685 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 19 | 18 | 21 | 21 | 20 | 23 | 16 | 16 |
| N.S. | 1 | 1.00 | 0.83 | 0.78 | 0.91 | 0.91 | 0.87 | 1.00 | 0.70 | 0.70 |
| time (sec) |
N/A | 0.004 | 0.001 | 0.129 | 0.267 | 0.291 | 0.055 | 0.001 | 0.030 | 1.599 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 8 | 8 | 8 | 9 | 8 | 8 | 7 | 9 | 8 | 8 |
| N.S. | 1 | 1.00 | 1.00 | 1.12 | 1.00 | 1.00 | 0.88 | 1.12 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.001 | 0.000 | 0.144 | 0.250 | 0.291 | 0.048 | 0.001 | 0.009 | 1.512 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 13 | 13 | 13 | 14 | 13 | 13 | 17 | 15 | 13 | 17 |
| N.S. | 1 | 1.00 | 1.00 | 1.08 | 1.00 | 1.00 | 1.31 | 1.15 | 1.00 | 1.31 |
| time (sec) |
N/A | 0.002 | 0.002 | 0.156 | 0.257 | 0.291 | 0.048 | 0.000 | 0.142 | 1.610 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 13 | 13 | 13 | 14 | 16 | 16 | 12 | 13 | 13 | 13 |
| N.S. | 1 | 1.00 | 1.00 | 1.08 | 1.23 | 1.23 | 0.92 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.002 | 0.003 | 0.131 | 0.255 | 0.291 | 0.075 | 0.001 | 0.040 | 1.612 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 36 | 36 | 44 | 12 | 38 | 34 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 2.57 | 2.57 | 3.14 | 0.86 | 2.71 | 2.43 |
| time (sec) |
N/A | 0.002 | 0.004 | 0.151 | 0.265 | 0.290 | 0.137 | 0.001 | 0.047 | 1.847 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 15 | 14 | 59 | 59 | 68 | 16 | 61 | 46 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 3.93 | 3.93 | 4.53 | 1.07 | 4.07 | 3.07 |
| time (sec) |
N/A | 0.002 | 0.004 | 0.132 | 0.254 | 0.289 | 0.176 | 0.001 | 0.050 | 2.061 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 16 | 75 | 75 | 83 | 18 | 77 | 59 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 4.41 | 4.41 | 4.88 | 1.06 | 4.53 | 3.47 |
| time (sec) |
N/A | 0.003 | 0.004 | 0.156 | 0.251 | 0.288 | 0.207 | 0.001 | 0.173 | 2.203 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 24 | 24 | 25 | 27 | 649 | 80 | 212 | 154 | 107 | 245 |
| N.S. | 1 | 1.00 | 1.04 | 1.12 | 27.04 | 3.33 | 8.83 | 6.42 | 4.46 | 10.21 |
| time (sec) |
N/A | 0.006 | 0.026 | 0.168 | 0.289 | 0.302 | 0.653 | 0.006 | 0.326 | 2.268 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 114 | 113 | 113 | 124 | 119 | 113 | 90 |
| N.S. | 1 | 1.00 | 1.00 | 6.71 | 6.65 | 6.65 | 7.29 | 7.00 | 6.65 | 5.29 |
| time (sec) |
N/A | 0.003 | 0.001 | 0.118 | 0.262 | 0.289 | 0.047 | 0.001 | 0.051 | 2.029 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 100 | 99 | 99 | 110 | 107 | 99 | 79 |
| N.S. | 1 | 1.00 | 1.00 | 5.88 | 5.82 | 5.82 | 6.47 | 6.29 | 5.82 | 4.65 |
| time (sec) |
N/A | 0.003 | 0.001 | 0.140 | 0.272 | 0.286 | 0.043 | 0.000 | 0.041 | 1.939 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 15 | 72 | 71 | 71 | 78 | 73 | 71 | 66 |
| N.S. | 1 | 1.00 | 1.00 | 4.80 | 4.73 | 4.73 | 5.20 | 4.87 | 4.73 | 4.40 |
| time (sec) |
N/A | 0.002 | 0.001 | 0.128 | 0.254 | 0.288 | 0.039 | 0.000 | 0.030 | 1.796 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 16 | 48 | 48 | 51 | 47 | 57 | 46 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 2.82 | 2.82 | 3.00 | 2.76 | 3.35 | 2.71 |
| time (sec) |
N/A | 0.003 | 0.001 | 0.150 | 0.277 | 0.290 | 0.049 | 0.000 | 0.025 | 1.755 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 16 | 37 | 37 | 46 | 40 | 43 | 35 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 2.18 | 2.18 | 2.71 | 2.35 | 2.53 | 2.06 |
| time (sec) |
N/A | 0.003 | 0.001 | 0.149 | 0.260 | 0.285 | 0.051 | 0.000 | 0.048 | 1.699 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 16 | 26 | 26 | 29 | 27 | 24 | 24 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 1.53 | 1.53 | 1.71 | 1.59 | 1.41 | 1.41 |
| time (sec) |
N/A | 0.003 | 0.001 | 0.151 | 0.279 | 0.293 | 0.051 | 0.001 | 0.036 | 1.635 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 18 | 18 | 16 | 15 | 15 | 15 | 15 | 17 | 13 | 13 |
| N.S. | 1 | 1.00 | 0.89 | 0.83 | 0.83 | 0.83 | 0.83 | 0.94 | 0.72 | 0.72 |
| time (sec) |
N/A | 0.003 | 0.001 | 0.143 | 0.257 | 0.291 | 0.051 | 0.001 | 0.024 | 1.571 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 5 | 5 | 5 | 6 | 5 | 5 | 3 | 6 | 5 | 5 |
| N.S. | 1 | 1.00 | 1.00 | 1.20 | 1.00 | 1.00 | 0.60 | 1.20 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.001 | 0.000 | 0.153 | 0.258 | 0.286 | 0.050 | 0.001 | 0.008 | 1.508 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 13 | 13 | 13 | 14 | 13 | 13 | 17 | 14 | 13 | 17 |
| N.S. | 1 | 1.00 | 1.00 | 1.08 | 1.00 | 1.00 | 1.31 | 1.08 | 1.00 | 1.31 |
| time (sec) |
N/A | 0.003 | 0.001 | 0.137 | 0.267 | 0.295 | 0.057 | 0.001 | 0.040 | 1.615 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 15 | 16 | 19 | 19 | 17 | 12 | 19 | 15 |
| N.S. | 1 | 1.00 | 1.00 | 1.07 | 1.27 | 1.27 | 1.13 | 0.80 | 1.27 | 1.00 |
| time (sec) |
N/A | 0.003 | 0.002 | 0.148 | 0.265 | 0.288 | 0.097 | 0.001 | 0.046 | 1.650 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 16 | 33 | 33 | 36 | 15 | 35 | 26 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 1.94 | 1.94 | 2.12 | 0.88 | 2.06 | 1.53 |
| time (sec) |
N/A | 0.003 | 0.003 | 0.125 | 0.260 | 0.287 | 0.127 | 0.001 | 0.146 | 1.797 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | C | A | A | C | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 28 | 23 | 6 | 1 | 66 | 14 | 35 | 94 |
| N.S. | 1 | 1.00 | 1.00 | 0.82 | 0.21 | 0.04 | 2.36 | 0.50 | 1.25 | 3.36 |
| time (sec) |
N/A | 0.002 | 0.004 | 0.158 | 0.342 | 0.300 | 0.589 | 0.001 | 0.222 | 2.388 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 40 | 45 | 44 | 44 | 44 | 49 | 44 | 36 |
| N.S. | 1 | 1.00 | 1.05 | 1.18 | 1.16 | 1.16 | 1.16 | 1.29 | 1.16 | 0.95 |
| time (sec) |
N/A | 0.008 | 0.002 | 0.135 | 0.311 | 0.288 | 0.037 | 0.001 | 0.160 | 1.687 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 42 | 45 | 44 | 44 | 46 | 52 | 44 | 36 |
| N.S. | 1 | 1.00 | 1.11 | 1.18 | 1.16 | 1.16 | 1.21 | 1.37 | 1.16 | 0.95 |
| time (sec) |
N/A | 0.013 | 0.002 | 0.106 | 0.263 | 0.285 | 0.035 | 0.000 | 0.048 | 1.683 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 18 | 18 | 18 | 17 | 16 | 16 | 15 | 19 | 18 | 18 |
| N.S. | 1 | 1.00 | 1.00 | 0.94 | 0.89 | 0.89 | 0.83 | 1.06 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.003 | 0.001 | 0.037 | 0.276 | 0.286 | 0.029 | 0.001 | 0.023 | 1.564 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 12 | 12 | 12 | 11 | 10 | 10 | 8 | 11 | 10 | 10 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.83 | 0.83 | 0.67 | 0.92 | 0.83 | 0.83 |
| time (sec) |
N/A | 0.002 | 0.000 | 0.006 | 0.255 | 0.263 | 0.026 | 0.000 | 0.017 | 1.520 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 23 | 22 | 24 | 23 | 17 | 25 | 23 | 23 |
| N.S. | 1 | 1.00 | 1.00 | 0.96 | 1.04 | 1.00 | 0.74 | 1.09 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.009 | 0.003 | 0.112 | 0.257 | 0.290 | 0.068 | 0.000 | 0.046 | 1.651 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 28 | 31 | 37 | 39 | 29 | 33 | 37 | 34 |
| N.S. | 1 | 1.00 | 0.88 | 0.97 | 1.16 | 1.22 | 0.91 | 1.03 | 1.16 | 1.06 |
| time (sec) |
N/A | 0.013 | 0.012 | 0.121 | 0.273 | 0.295 | 0.097 | 0.001 | 0.052 | 1.822 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 13 | 13 | 13 | 32 | 30 | 30 | 27 | 15 | 13 | 23 |
| N.S. | 1 | 1.00 | 1.00 | 2.46 | 2.31 | 2.31 | 2.08 | 1.15 | 1.00 | 1.77 |
| time (sec) |
N/A | 0.002 | 0.006 | 0.138 | 0.255 | 0.291 | 0.120 | 0.001 | 0.148 | 1.763 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 25 | 33 | 54 | 54 | 56 | 25 | 54 | 44 |
| N.S. | 1 | 1.00 | 0.66 | 0.87 | 1.42 | 1.42 | 1.47 | 0.66 | 1.42 | 1.16 |
| time (sec) |
N/A | 0.014 | 0.008 | 0.112 | 0.257 | 0.288 | 0.154 | 0.001 | 0.049 | 1.987 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 24 | 33 | 67 | 67 | 73 | 22 | 67 | 54 |
| N.S. | 1 | 1.00 | 0.63 | 0.87 | 1.76 | 1.76 | 1.92 | 0.58 | 1.76 | 1.42 |
| time (sec) |
N/A | 0.014 | 0.007 | 0.128 | 0.261 | 0.289 | 0.194 | 0.001 | 0.167 | 2.103 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 27 | 33 | 84 | 84 | 88 | 27 | 82 | 68 |
| N.S. | 1 | 1.00 | 0.71 | 0.87 | 2.21 | 2.21 | 2.32 | 0.71 | 2.16 | 1.79 |
| time (sec) |
N/A | 0.014 | 0.009 | 0.136 | 0.274 | 0.292 | 0.226 | 0.001 | 0.075 | 2.250 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 68 | 73 | 72 | 72 | 78 | 85 | 72 | 58 |
| N.S. | 1 | 1.00 | 1.19 | 1.28 | 1.26 | 1.26 | 1.37 | 1.49 | 1.26 | 1.02 |
| time (sec) |
N/A | 0.021 | 0.003 | 0.168 | 0.254 | 0.288 | 0.040 | 0.000 | 0.032 | 1.803 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 38 | 35 | 34 | 34 | 36 | 39 | 31 | 31 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.89 | 0.89 | 0.95 | 1.03 | 0.82 | 0.82 |
| time (sec) |
N/A | 0.011 | 0.001 | 0.129 | 0.280 | 0.291 | 0.037 | 0.000 | 0.040 | 1.644 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 40 | 37 | 36 | 36 | 39 | 44 | 36 | 34 |
| N.S. | 1 | 1.00 | 1.25 | 1.16 | 1.12 | 1.12 | 1.22 | 1.38 | 1.12 | 1.06 |
| time (sec) |
N/A | 0.012 | 0.001 | 0.125 | 0.271 | 0.287 | 0.034 | 0.000 | 0.049 | 1.647 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 20 | 20 | 19 | 12 | 20 | 18 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 1.43 | 1.43 | 1.36 | 0.86 | 1.43 | 1.29 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.125 | 0.290 | 0.283 | 0.030 | 0.000 | 0.027 | 1.578 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 37 | 31 | 35 | 34 | 31 | 50 | 34 | 33 |
| N.S. | 1 | 1.00 | 0.86 | 0.72 | 0.81 | 0.79 | 0.72 | 1.16 | 0.79 | 0.77 |
| time (sec) |
N/A | 0.010 | 0.005 | 0.176 | 0.256 | 0.288 | 0.083 | 0.000 | 0.047 | 1.735 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 35 | 36 | 46 | 57 | 39 | 50 | 46 | 47 |
| N.S. | 1 | 1.00 | 0.85 | 0.88 | 1.12 | 1.39 | 0.95 | 1.22 | 1.12 | 1.15 |
| time (sec) |
N/A | 0.016 | 0.019 | 0.155 | 0.255 | 0.294 | 0.105 | 0.001 | 0.149 | 1.890 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 52 | 52 | 33 | 48 | 61 | 69 | 54 | 48 | 59 | 61 |
| N.S. | 1 | 1.00 | 0.63 | 0.92 | 1.17 | 1.33 | 1.04 | 0.92 | 1.13 | 1.17 |
| time (sec) |
N/A | 0.019 | 0.015 | 0.127 | 0.266 | 0.297 | 0.161 | 0.001 | 0.172 | 2.058 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 31 | 48 | 60 | 60 | 61 | 28 | 58 | 50 |
| N.S. | 1 | 1.00 | 1.11 | 1.71 | 2.14 | 2.14 | 2.18 | 1.00 | 2.07 | 1.79 |
| time (sec) |
N/A | 0.003 | 0.012 | 0.144 | 0.263 | 0.288 | 0.179 | 0.001 | 0.046 | 2.039 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 56 | 56 | 35 | 48 | 78 | 78 | 85 | 33 | 76 | 65 |
| N.S. | 1 | 1.00 | 0.62 | 0.86 | 1.39 | 1.39 | 1.52 | 0.59 | 1.36 | 1.16 |
| time (sec) |
N/A | 0.017 | 0.008 | 0.149 | 0.258 | 0.292 | 0.223 | 0.001 | 0.052 | 2.190 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 38 | 49 | 95 | 95 | 100 | 35 | 91 | 79 |
| N.S. | 1 | 1.00 | 0.67 | 0.86 | 1.67 | 1.67 | 1.75 | 0.61 | 1.60 | 1.39 |
| time (sec) |
N/A | 0.018 | 0.012 | 0.146 | 0.273 | 0.293 | 0.253 | 0.001 | 0.187 | 2.324 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 59 | 59 | 37 | 49 | 108 | 108 | 117 | 35 | 104 | 89 |
| N.S. | 1 | 1.00 | 0.63 | 0.83 | 1.83 | 1.83 | 1.98 | 0.59 | 1.76 | 1.51 |
| time (sec) |
N/A | 0.020 | 0.010 | 0.161 | 0.295 | 0.289 | 0.293 | 0.001 | 0.108 | 2.560 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 42 | 41 | 48 | 52 | 49 | 63 | 48 | 42 |
| N.S. | 1 | 1.00 | 0.69 | 0.67 | 0.79 | 0.85 | 0.80 | 1.03 | 0.79 | 0.69 |
| time (sec) |
N/A | 0.015 | 0.004 | 0.152 | 0.282 | 0.287 | 0.096 | 0.001 | 0.049 | 1.786 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 31 | 30 | 34 | 38 | 34 | 48 | 32 | 30 |
| N.S. | 1 | 1.00 | 0.72 | 0.70 | 0.79 | 0.88 | 0.79 | 1.12 | 0.74 | 0.70 |
| time (sec) |
N/A | 0.011 | 0.004 | 0.149 | 0.264 | 0.297 | 0.094 | 0.000 | 0.148 | 1.697 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 18 | 18 | 18 | 19 | 18 | 20 | 15 | 21 | 18 | 19 |
| N.S. | 1 | 1.00 | 1.00 | 1.06 | 1.00 | 1.11 | 0.83 | 1.17 | 1.00 | 1.06 |
| time (sec) |
N/A | 0.007 | 0.002 | 0.137 | 0.258 | 0.295 | 0.061 | 0.001 | 0.039 | 1.607 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 10 | 10 | 10 | 11 | 10 | 10 | 7 | 10 | 10 | 10 |
| N.S. | 1 | 1.00 | 1.00 | 1.10 | 1.00 | 1.00 | 0.70 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.129 | 0.268 | 0.284 | 0.029 | 0.000 | 0.019 | 1.535 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 35 | 37 | 28 | 22 | 37 | 17 | 31 |
| N.S. | 1 | 1.00 | 1.00 | 2.06 | 2.18 | 1.65 | 1.29 | 2.18 | 1.00 | 1.82 |
| time (sec) |
N/A | 0.006 | 0.004 | 0.155 | 0.301 | 0.302 | 0.088 | 0.001 | 0.170 | 1.802 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 42 | 42 | 53 | 51 | 60 | 60 | 48 | 63 | 42 | 55 |
| N.S. | 1 | 1.00 | 1.26 | 1.21 | 1.43 | 1.43 | 1.14 | 1.50 | 1.00 | 1.31 |
| time (sec) |
N/A | 0.021 | 0.011 | 0.146 | 0.253 | 0.298 | 0.146 | 0.001 | 0.071 | 2.120 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 63 | 63 | 65 | 67 | 82 | 98 | 71 | 74 | 64 | 83 |
| N.S. | 1 | 1.00 | 1.03 | 1.06 | 1.30 | 1.56 | 1.13 | 1.17 | 1.02 | 1.32 |
| time (sec) |
N/A | 0.027 | 0.014 | 0.184 | 0.265 | 0.292 | 0.190 | 0.001 | 0.078 | 2.401 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 54 | 54 | 46 | 45 | 53 | 79 | 51 | 66 | 52 | 53 |
| N.S. | 1 | 1.00 | 0.85 | 0.83 | 0.98 | 1.46 | 0.94 | 1.22 | 0.96 | 0.98 |
| time (sec) |
N/A | 0.022 | 0.013 | 0.153 | 0.261 | 0.290 | 0.119 | 0.001 | 0.055 | 1.888 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 39 | 39 | 33 | 34 | 40 | 61 | 36 | 46 | 39 | 42 |
| N.S. | 1 | 1.00 | 0.85 | 0.87 | 1.03 | 1.56 | 0.92 | 1.18 | 1.00 | 1.08 |
| time (sec) |
N/A | 0.015 | 0.011 | 0.153 | 0.261 | 0.293 | 0.108 | 0.001 | 0.168 | 1.798 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 27 | 27 | 23 | 28 | 28 | 33 | 24 | 26 | 27 | 29 |
| N.S. | 1 | 1.00 | 0.85 | 1.04 | 1.04 | 1.22 | 0.89 | 0.96 | 1.00 | 1.07 |
| time (sec) |
N/A | 0.010 | 0.007 | 0.145 | 0.268 | 0.293 | 0.093 | 0.001 | 0.043 | 1.739 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 12 | 12 | 12 | 13 | 12 | 13 | 10 | 9 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 1.08 | 1.00 | 1.08 | 0.83 | 0.75 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.128 | 0.270 | 0.285 | 0.065 | 0.000 | 0.024 | 1.601 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 50 | 50 | 55 | 51 | 44 | 56 | 37 | 53 |
| N.S. | 1 | 1.00 | 1.22 | 1.22 | 1.34 | 1.24 | 1.07 | 1.37 | 0.90 | 1.29 |
| time (sec) |
N/A | 0.019 | 0.010 | 0.150 | 0.263 | 0.298 | 0.144 | 0.001 | 0.177 | 2.092 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 46 | 46 | 74 | 66 | 64 | 76 | 49 | 68 | 46 | 69 |
| N.S. | 1 | 1.00 | 1.61 | 1.43 | 1.39 | 1.65 | 1.07 | 1.48 | 1.00 | 1.50 |
| time (sec) |
N/A | 0.011 | 0.015 | 0.165 | 0.271 | 0.300 | 0.135 | 0.001 | 0.181 | 2.169 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 83 | 83 | 68 | 82 | 108 | 146 | 104 | 93 | 86 | 117 |
| N.S. | 1 | 1.00 | 0.82 | 0.99 | 1.30 | 1.76 | 1.25 | 1.12 | 1.04 | 1.41 |
| time (sec) |
N/A | 0.035 | 0.026 | 0.178 | 0.261 | 0.296 | 0.250 | 0.001 | 0.098 | 2.778 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 108 | 108 | 73 | 113 | 68 | 62 | 287 | 582 | -1 | 196 |
| N.S. | 1 | 1.00 | 0.68 | 1.05 | 0.63 | 0.57 | 2.66 | 5.39 | -0.01 | 1.81 |
| time (sec) |
N/A | 0.016 | 0.086 | 0.164 | 0.348 | 0.306 | 96.653 | 0.037 | 0.000 | 70.670 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 88 | 88 | 68 | 99 | 54 | 57 | 252 | 429 | -1 | 175 |
| N.S. | 1 | 1.00 | 0.77 | 1.12 | 0.61 | 0.65 | 2.86 | 4.88 | -0.01 | 1.99 |
| time (sec) |
N/A | 0.011 | 0.074 | 0.154 | 0.368 | 0.299 | 30.389 | 0.025 | 0.000 | 24.888 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 63 | 85 | 40 | 52 | 216 | 298 | -1 | 154 |
| N.S. | 1 | 1.00 | 0.93 | 1.25 | 0.59 | 0.76 | 3.18 | 4.38 | -0.01 | 2.26 |
| time (sec) |
N/A | 0.007 | 0.072 | 0.163 | 0.361 | 0.296 | 9.329 | 0.019 | 0.000 | 9.831 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 52 | 71 | 28 | 47 | 167 | 189 | -1 | 129 |
| N.S. | 1 | 1.00 | 1.08 | 1.48 | 0.58 | 0.98 | 3.48 | 3.94 | -0.02 | 2.69 |
| time (sec) |
N/A | 0.004 | 0.062 | 0.159 | 0.354 | 0.296 | 3.396 | 0.012 | 0.000 | 5.088 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 37 | 57 | 17 | 38 | 131 | 103 | 37 | 106 |
| N.S. | 1 | 1.00 | 1.32 | 2.04 | 0.61 | 1.36 | 4.68 | 3.68 | 1.32 | 3.79 |
| time (sec) |
N/A | 0.003 | 0.040 | 0.155 | 0.355 | 0.298 | 1.614 | 0.006 | 0.205 | 3.422 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 34 | 42 | 14 | 37 | 99 | 35 | 14 | 90 |
| N.S. | 1 | 1.00 | 1.62 | 2.00 | 0.67 | 1.76 | 4.71 | 1.67 | 0.67 | 4.29 |
| time (sec) |
N/A | 0.003 | 0.060 | 0.166 | 0.359 | 0.292 | 0.943 | 0.004 | 0.145 | 2.734 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 39 | 64 | 21 | 48 | 70 | 41 | -1 | 63 |
| N.S. | 1 | 1.00 | 1.70 | 2.78 | 0.91 | 2.09 | 3.04 | 1.78 | -0.04 | 2.74 |
| time (sec) |
N/A | 0.003 | 0.035 | 0.186 | 0.346 | 0.293 | 0.764 | 0.005 | 0.000 | 2.478 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 20 | 30 | 38 | 33 | 60 | 39 | 34 | 52 |
| N.S. | 1 | 1.00 | 1.00 | 1.50 | 1.90 | 1.65 | 3.00 | 1.95 | 1.70 | 2.60 |
| time (sec) |
N/A | 0.001 | 0.049 | 0.155 | 0.260 | 0.299 | 0.918 | 0.007 | 0.270 | 2.518 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 23 | 44 | 64 | 53 | 172 | 59 | 50 | 125 |
| N.S. | 1 | 1.00 | 0.56 | 1.07 | 1.56 | 1.29 | 4.20 | 1.44 | 1.22 | 3.05 |
| time (sec) |
N/A | 0.003 | 0.043 | 0.149 | 0.255 | 0.298 | 4.765 | 0.011 | 0.244 | 5.657 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 30 | 58 | 95 | 70 | 566 | 77 | 64 | 344 |
| N.S. | 1 | 1.00 | 0.49 | 0.95 | 1.56 | 1.15 | 9.28 | 1.26 | 1.05 | 5.64 |
| time (sec) |
N/A | 0.006 | 0.049 | 0.142 | 0.275 | 0.297 | 18.413 | 0.014 | 0.269 | 15.471 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 35 | 72 | 131 | 85 | 1561 | 96 | 80 | 867 |
| N.S. | 1 | 1.00 | 0.43 | 0.89 | 1.62 | 1.05 | 19.27 | 1.19 | 0.99 | 10.70 |
| time (sec) |
N/A | 0.009 | 0.053 | 0.170 | 0.262 | 0.293 | 61.442 | 0.017 | 0.282 | 43.369 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 40 | 86 | 172 | 100 | 3648 | 119 | 94 | 1953 |
| N.S. | 1 | 1.00 | 0.40 | 0.85 | 1.70 | 0.99 | 36.12 | 1.18 | 0.93 | 19.34 |
| time (sec) |
N/A | 0.013 | 0.060 | 0.158 | 0.262 | 0.296 | 178.230 | 0.023 | 0.292 | 112.433 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-1) | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 109 | 109 | 78 | 127 | 66 | 67 | 0 | 647 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 1.17 | 0.61 | 0.61 | 0.00 | 5.94 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.130 | 0.137 | 0.348 | 0.299 | 0.000 | 0.037 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 89 | 89 | 73 | 113 | 52 | 62 | 287 | 583 | -1 | 196 |
| N.S. | 1 | 1.00 | 0.82 | 1.27 | 0.58 | 0.70 | 3.22 | 6.55 | -0.01 | 2.20 |
| time (sec) |
N/A | 0.010 | 0.113 | 0.161 | 0.350 | 0.295 | 114.357 | 0.035 | 0.000 | 98.884 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 69 | 69 | 68 | 99 | 40 | 57 | 248 | 343 | -1 | 175 |
| N.S. | 1 | 1.00 | 0.99 | 1.43 | 0.58 | 0.83 | 3.59 | 4.97 | -0.01 | 2.54 |
| time (sec) |
N/A | 0.006 | 0.093 | 0.143 | 0.348 | 0.298 | 35.948 | 0.020 | 0.000 | 35.718 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 46 | 85 | 29 | 46 | 212 | 298 | -1 | 154 |
| N.S. | 1 | 1.00 | 0.94 | 1.73 | 0.59 | 0.94 | 4.33 | 6.08 | -0.02 | 3.14 |
| time (sec) |
N/A | 0.005 | 0.065 | 0.141 | 0.364 | 0.300 | 11.655 | 0.019 | 0.000 | 13.502 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 48 | 48 | 54 | 71 | 28 | 47 | 163 | 124 | -1 | 129 |
| N.S. | 1 | 1.00 | 1.12 | 1.48 | 0.58 | 0.98 | 3.40 | 2.58 | -0.02 | 2.69 |
| time (sec) |
N/A | 0.004 | 0.062 | 0.135 | 0.354 | 0.310 | 4.733 | 0.008 | 0.000 | 6.724 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 49 | 57 | 28 | 40 | 134 | 58 | -1 | 112 |
| N.S. | 1 | 1.00 | 1.04 | 1.21 | 0.60 | 0.85 | 2.85 | 1.23 | -0.02 | 2.38 |
| time (sec) |
N/A | 0.005 | 0.049 | 0.159 | 0.359 | 0.299 | 2.356 | 0.006 | 0.000 | 4.365 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 41 | 72 | 42 | 52 | 99 | 61 | -1 | 89 |
| N.S. | 1 | 1.00 | 1.00 | 1.76 | 1.02 | 1.27 | 2.41 | 1.49 | -0.02 | 2.17 |
| time (sec) |
N/A | 0.005 | 0.099 | 0.163 | 0.347 | 0.298 | 1.666 | 0.008 | 0.000 | 3.673 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | C | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 46 | 76 | 66 | 71 | 498 | 62 | -1 | 266 |
| N.S. | 1 | 1.00 | 1.12 | 1.85 | 1.61 | 1.73 | 12.15 | 1.51 | -0.02 | 6.49 |
| time (sec) |
N/A | 0.004 | 0.059 | 0.164 | 0.364 | 0.297 | 2.185 | 0.008 | 0.000 | 6.392 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 20 | 57 | 94 | 52 | 87 | 53 | 50 | 75 |
| N.S. | 1 | 1.00 | 1.00 | 2.85 | 4.70 | 2.60 | 4.35 | 2.65 | 2.50 | 3.75 |
| time (sec) |
N/A | 0.001 | 0.042 | 0.132 | 0.271 | 0.295 | 4.731 | 0.011 | 0.252 | 5.620 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 23 | 72 | 131 | 69 | 226 | 73 | 64 | 159 |
| N.S. | 1 | 1.00 | 0.56 | 1.76 | 3.20 | 1.68 | 5.51 | 1.78 | 1.56 | 3.88 |
| time (sec) |
N/A | 0.003 | 0.050 | 0.138 | 0.284 | 0.301 | 18.369 | 0.014 | 0.268 | 14.750 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 30 | 86 | 172 | 86 | 675 | 91 | 80 | 410 |
| N.S. | 1 | 1.00 | 0.49 | 1.41 | 2.82 | 1.41 | 11.07 | 1.49 | 1.31 | 6.72 |
| time (sec) |
N/A | 0.006 | 0.054 | 0.176 | 0.284 | 0.297 | 61.159 | 0.019 | 0.319 | 40.826 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 35 | 100 | 218 | 101 | 1751 | 111 | 94 | 975 |
| N.S. | 1 | 1.00 | 0.43 | 1.23 | 2.69 | 1.25 | 21.62 | 1.37 | 1.16 | 12.04 |
| time (sec) |
N/A | 0.010 | 0.061 | 0.158 | 0.271 | 0.298 | 177.970 | 0.022 | 0.310 | 107.599 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | F(-2) | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 40 | 114 | 269 | 116 | 0 | 133 | 110 | 0 |
| N.S. |
1 | 1.00 | 0.40 | 1.13 | 2.66 | 1.15 | 0.00 | 1.32 | 1.09 | 0.00 |
| time (sec) |
N/A | 0.015 | 0.067 | 0.140 | 0.278 | 0.306 | 0.000 | 0.028 | 0.328 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-2) | B | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 130 | 130 | 88 | 155 | 78 | 77 | 0 | 1174 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 1.19 | 0.60 | 0.59 | 0.00 | 9.03 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.019 | 0.167 | 0.139 | 0.346 | 0.293 | 0.000 | 0.061 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-1) | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 110 | 110 | 82 | 141 | 64 | 72 | 0 | 954 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.75 | 1.28 | 0.58 | 0.65 | 0.00 | 8.67 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.140 | 0.140 | 0.352 | 0.301 | 0.000 | 0.050 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-1) | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 90 | 90 | 78 | 127 | 52 | 67 | 0 | 756 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.87 | 1.41 | 0.58 | 0.74 | 0.00 | 8.40 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.119 | 0.162 | 0.350 | 0.302 | 0.000 | 0.040 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | F(-1) | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 70 | 70 | 51 | 113 | 41 | 51 | 0 | 582 | -1 | 196 |
| N.S. |
1 | 1.00 | 0.73 | 1.61 | 0.59 | 0.73 | 0.00 | 8.31 | -0.01 | 2.80 |
| time (sec) |
N/A | 0.008 | 0.080 | 0.152 | 0.405 | 0.305 | 0.000 | 0.033 | 0.000 | 194.105 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 69 | 69 | 68 | 99 | 40 | 57 | 245 | 255 | -1 | 175 |
| N.S. | 1 | 1.00 | 0.99 | 1.43 | 0.58 | 0.83 | 3.55 | 3.70 | -0.01 | 2.54 |
| time (sec) |
N/A | 0.006 | 0.088 | 0.161 | 0.345 | 0.292 | 61.199 | 0.014 | 0.000 | 64.068 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 63 | 85 | 40 | 52 | 212 | 298 | -1 | 154 |
| N.S. | 1 | 1.00 | 0.93 | 1.25 | 0.59 | 0.76 | 3.12 | 4.38 | -0.01 | 2.26 |
| time (sec) |
N/A | 0.007 | 0.064 | 0.136 | 0.342 | 0.295 | 21.502 | 0.020 | 0.000 | 22.849 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 56 | 71 | 42 | 47 | 170 | 78 | -1 | 133 |
| N.S. | 1 | 1.00 | 0.84 | 1.06 | 0.63 | 0.70 | 2.54 | 1.16 | -0.01 | 1.99 |
| time (sec) |
N/A | 0.009 | 0.054 | 0.141 | 0.343 | 0.299 | 9.511 | 0.005 | 0.000 | 10.517 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 49 | 77 | 56 | 58 | 138 | 84 | -1 | 110 |
| N.S. | 1 | 1.00 | 0.75 | 1.18 | 0.86 | 0.89 | 2.12 | 1.29 | -0.02 | 1.69 |
| time (sec) |
N/A | 0.008 | 0.066 | 0.184 | 0.384 | 0.297 | 6.184 | 0.006 | 0.000 | 7.253 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | C | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 63 | 63 | 51 | 84 | 99 | 75 | 575 | 82 | -1 | 311 |
| N.S. | 1 | 1.00 | 0.81 | 1.33 | 1.57 | 1.19 | 9.13 | 1.30 | -0.02 | 4.94 |
| time (sec) |
N/A | 0.008 | 0.130 | 0.164 | 0.348 | 0.297 | 5.097 | 0.008 | 0.000 | 9.321 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | C | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 63 | 63 | 51 | 84 | 160 | 91 | 1606 | 83 | -1 | 746 |
| N.S. | 1 | 1.00 | 0.81 | 1.33 | 2.54 | 1.44 | 25.49 | 1.32 | -0.02 | 11.84 |
| time (sec) |
N/A | 0.005 | 0.056 | 0.164 | 0.358 | 0.291 | 8.544 | 0.011 | 0.000 | 18.349 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 20 | 85 | 171 | 66 | 114 | 67 | 64 | 95 |
| N.S. | 1 | 1.00 | 1.00 | 4.25 | 8.55 | 3.30 | 5.70 | 3.35 | 3.20 | 4.75 |
| time (sec) |
N/A | 0.001 | 0.045 | 0.138 | 0.264 | 0.301 | 19.710 | 0.014 | 0.279 | 14.128 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 23 | 100 | 218 | 83 | 280 | 87 | 80 | 191 |
| N.S. | 1 | 1.00 | 0.56 | 2.44 | 5.32 | 2.02 | 6.83 | 2.12 | 1.95 | 4.66 |
| time (sec) |
N/A | 0.003 | 0.051 | 0.144 | 0.283 | 0.294 | 67.283 | 0.018 | 0.303 | 37.914 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F(-1) | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 30 | 114 | 269 | 100 | 0 | 105 | 94 | 475 |
| N.S. |
1 | 1.00 | 0.49 | 1.87 | 4.41 | 1.64 | 0.00 | 1.72 | 1.54 | 7.79 |
| time (sec) |
N/A | 0.006 | 0.057 | 0.138 | 0.260 | 0.297 | 0.000 | 0.023 | 0.310 | 103.284 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F(-2) | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 35 | 128 | 325 | 115 | 0 | 124 | 110 | 0 |
| N.S. |
1 | 1.00 | 0.43 | 1.58 | 4.01 | 1.42 | 0.00 | 1.53 | 1.36 | 0.00 |
| time (sec) |
N/A | 0.010 | 0.061 | 0.161 | 0.272 | 0.304 | 0.000 | 0.028 | 0.315 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | F(-2) | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 40 | 142 | 386 | 130 | 0 | 147 | 124 | 0 |
| N.S. |
1 | 1.00 | 0.40 | 1.41 | 3.82 | 1.29 | 0.00 | 1.46 | 1.23 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.071 | 0.160 | 0.262 | 0.296 | 0.000 | 0.034 | 0.352 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | F(-1) | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 121 | 121 | 45 | 156 | 452 | 145 | 0 | 167 | 140 | 0 |
| N.S. |
1 | 1.00 | 0.37 | 1.29 | 3.74 | 1.20 | 0.00 | 1.38 | 1.16 | 0.00 |
| time (sec) |
N/A | 0.019 | 0.076 | 0.176 | 0.274 | 0.296 | 0.000 | 0.043 | 0.370 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 64 | 98 | 42 | 55 | 88 | 71 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 1.53 | 0.66 | 0.86 | 1.38 | 1.11 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.087 | 0.152 | 0.372 | 0.301 | 16.284 | 0.005 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | A | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 62 | 62 | 69 | 120 | 42 | 48 | 76 | 47 | 55 | 0 |
| N.S. |
1 | 1.00 | 1.11 | 1.94 | 0.68 | 0.77 | 1.23 | 0.76 | 0.89 | 0.00 |
| time (sec) |
N/A | 0.024 | 0.163 | 0.155 | 0.343 | 0.299 | 3.114 | 0.007 | 0.151 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 87 | 87 | 63 | 85 | 56 | 52 | 197 | 107 | -1 | 157 |
| N.S. | 1 | 1.00 | 0.72 | 0.98 | 0.64 | 0.60 | 2.26 | 1.23 | -0.01 | 1.80 |
| time (sec) |
N/A | 0.014 | 0.058 | 0.138 | 0.344 | 0.300 | 16.461 | 0.009 | 0.000 | 14.283 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 56 | 71 | 42 | 47 | 173 | 83 | -1 | 133 |
| N.S. | 1 | 1.00 | 0.84 | 1.06 | 0.63 | 0.70 | 2.58 | 1.24 | -0.01 | 1.99 |
| time (sec) |
N/A | 0.008 | 0.057 | 0.162 | 0.361 | 0.305 | 4.536 | 0.007 | 0.000 | 5.903 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 49 | 57 | 28 | 40 | 138 | 61 | -1 | 112 |
| N.S. | 1 | 1.00 | 1.04 | 1.21 | 0.60 | 0.85 | 2.94 | 1.30 | -0.02 | 2.38 |
| time (sec) |
N/A | 0.005 | 0.049 | 0.155 | 0.348 | 0.296 | 1.525 | 0.006 | 0.000 | 3.600 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 32 | 41 | 12 | 36 | 99 | 36 | 12 | 89 |
| N.S. | 1 | 1.00 | 1.60 | 2.05 | 0.60 | 1.80 | 4.95 | 1.80 | 0.60 | 4.45 |
| time (sec) |
N/A | 0.003 | 0.057 | 0.159 | 0.354 | 0.299 | 0.795 | 0.004 | 0.119 | 2.955 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | A | B | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 2 | 2 | 14 | 27 | 2 | 22 | 39 | 19 | 22 | 35 |
| N.S. | 1 | 1.00 | 7.00 | 13.50 | 1.00 | 11.00 | 19.50 | 9.50 | 11.00 | 17.50 |
| time (sec) |
N/A | 0.001 | 0.018 | 0.136 | 0.367 | 0.298 | 0.488 | 0.001 | 0.078 | 2.313 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 14 | 16 | 23 | 31 | 64 | 13 | 48 |
| N.S. | 1 | 1.00 | 1.00 | 0.82 | 0.94 | 1.35 | 1.82 | 3.76 | 0.76 | 2.82 |
| time (sec) |
N/A | 0.003 | 0.014 | 0.132 | 0.347 | 0.303 | 0.494 | 0.002 | 0.283 | 2.664 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 23 | 30 | 38 | 39 | 128 | 149 | 43 | 106 |
| N.S. | 1 | 1.00 | 0.56 | 0.73 | 0.93 | 0.95 | 3.12 | 3.63 | 1.05 | 2.59 |
| time (sec) |
N/A | 0.003 | 0.039 | 0.134 | 0.354 | 0.297 | 1.332 | 0.005 | 0.309 | 3.873 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 30 | 44 | 64 | 56 | 303 | 222 | 55 | 211 |
| N.S. | 1 | 1.00 | 0.49 | 0.72 | 1.05 | 0.92 | 4.97 | 3.64 | 0.90 | 3.46 |
| time (sec) |
N/A | 0.006 | 0.045 | 0.145 | 0.349 | 0.296 | 5.540 | 0.007 | 0.324 | 8.258 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 35 | 58 | 95 | 71 | 542 | 293 | 67 | 350 |
| N.S. | 1 | 1.00 | 0.43 | 0.72 | 1.17 | 0.88 | 6.69 | 3.62 | 0.83 | 4.32 |
| time (sec) |
N/A | 0.009 | 0.051 | 0.135 | 0.354 | 0.294 | 19.201 | 0.011 | 0.345 | 20.022 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 40 | 72 | 131 | 86 | 850 | 366 | 80 | 525 |
| N.S. | 1 | 1.00 | 0.40 | 0.71 | 1.30 | 0.85 | 8.42 | 3.62 | 0.79 | 5.20 |
| time (sec) |
N/A | 0.013 | 0.055 | 0.158 | 0.351 | 0.297 | 57.544 | 0.015 | 0.363 | 49.641 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 85 | 85 | 56 | 84 | 70 | 65 | 206 | 108 | -1 | 154 |
| N.S. | 1 | 1.00 | 0.66 | 0.99 | 0.82 | 0.76 | 2.42 | 1.27 | -0.01 | 1.81 |
| time (sec) |
N/A | 0.011 | 0.079 | 0.143 | 0.352 | 0.306 | 16.722 | 0.008 | 0.000 | 14.866 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 49 | 77 | 56 | 58 | 167 | 86 | -1 | 129 |
| N.S. | 1 | 1.00 | 0.75 | 1.18 | 0.86 | 0.89 | 2.57 | 1.32 | -0.02 | 1.98 |
| time (sec) |
N/A | 0.008 | 0.065 | 0.161 | 0.347 | 0.294 | 4.888 | 0.006 | 0.000 | 6.235 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 43 | 71 | 41 | 53 | 131 | 61 | -1 | 105 |
| N.S. | 1 | 1.00 | 1.05 | 1.73 | 1.00 | 1.29 | 3.20 | 1.49 | -0.02 | 2.56 |
| time (sec) |
N/A | 0.005 | 0.090 | 0.157 | 0.363 | 0.298 | 1.379 | 0.007 | 0.000 | 3.420 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | C | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 39 | 67 | 21 | 50 | 102 | 41 | -1 | 77 |
| N.S. | 1 | 1.00 | 1.70 | 2.91 | 0.91 | 2.17 | 4.43 | 1.78 | -0.04 | 3.35 |
| time (sec) |
N/A | 0.003 | 0.033 | 0.136 | 0.343 | 0.303 | 0.737 | 0.005 | 0.000 | 2.774 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 18 | 18 | 18 | 15 | 16 | 23 | 31 | 21 | 14 | 39 |
| N.S. | 1 | 1.00 | 1.00 | 0.83 | 0.89 | 1.28 | 1.72 | 1.17 | 0.78 | 2.17 |
| time (sec) |
N/A | 0.001 | 0.014 | 0.138 | 0.337 | 0.295 | 0.506 | 0.002 | 0.360 | 2.246 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 18 | 18 | 13 | 29 | 11 | 22 | 63 | 87 | 14 | 64 |
| N.S. | 1 | 1.00 | 0.72 | 1.61 | 0.61 | 1.22 | 3.50 | 4.83 | 0.78 | 3.56 |
| time (sec) |
N/A | 0.001 | 0.027 | 0.154 | 0.267 | 0.296 | 0.973 | 0.003 | 0.305 | 3.010 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 42 | 42 | 30 | 44 | 40 | 54 | 160 | 171 | 42 | 133 |
| N.S. | 1 | 1.00 | 0.71 | 1.05 | 0.95 | 1.29 | 3.81 | 4.07 | 1.00 | 3.17 |
| time (sec) |
N/A | 0.003 | 0.048 | 0.136 | 0.269 | 0.293 | 3.467 | 0.007 | 0.322 | 5.373 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 62 | 62 | 33 | 58 | 79 | 59 | 284 | 243 | 55 | 206 |
| N.S. | 1 | 1.00 | 0.53 | 0.94 | 1.27 | 0.95 | 4.58 | 3.92 | 0.89 | 3.32 |
| time (sec) |
N/A | 0.006 | 0.053 | 0.162 | 0.255 | 0.300 | 13.056 | 0.009 | 0.337 | 13.122 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 40 | 72 | 134 | 86 | 425 | 315 | 68 | 290 |
| N.S. | 1 | 1.00 | 0.49 | 0.88 | 1.63 | 1.05 | 5.18 | 3.84 | 0.83 | 3.54 |
| time (sec) |
N/A | 0.010 | 0.056 | 0.145 | 0.266 | 0.294 | 42.082 | 0.015 | 0.355 | 34.250 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 102 | 102 | 45 | 86 | 201 | 91 | 593 | 387 | 80 | 388 |
| N.S. | 1 | 1.00 | 0.44 | 0.84 | 1.97 | 0.89 | 5.81 | 3.79 | 0.78 | 3.80 |
| time (sec) |
N/A | 0.013 | 0.062 | 0.139 | 0.270 | 0.291 | 117.565 | 0.021 | 0.363 | 88.366 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 103 | 103 | 61 | 89 | 125 | 85 | 248 | 127 | -1 | 193 |
| N.S. | 1 | 1.00 | 0.59 | 0.86 | 1.21 | 0.83 | 2.41 | 1.23 | -0.01 | 1.87 |
| time (sec) |
N/A | 0.015 | 0.091 | 0.167 | 0.339 | 0.297 | 53.135 | 0.012 | 0.000 | 38.272 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 87 | 87 | 56 | 84 | 111 | 81 | 212 | 108 | -1 | 172 |
| N.S. | 1 | 1.00 | 0.64 | 0.97 | 1.28 | 0.93 | 2.44 | 1.24 | -0.01 | 1.98 |
| time (sec) |
N/A | 0.012 | 0.078 | 0.161 | 0.344 | 0.299 | 16.625 | 0.010 | 0.000 | 14.597 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | C | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 63 | 63 | 51 | 79 | 98 | 75 | 162 | 86 | -1 | 171 |
| N.S. | 1 | 1.00 | 0.81 | 1.25 | 1.56 | 1.19 | 2.57 | 1.37 | -0.02 | 2.71 |
| time (sec) |
N/A | 0.008 | 0.122 | 0.170 | 0.347 | 0.295 | 4.835 | 0.010 | 0.000 | 6.467 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | C | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 46 | 73 | 66 | 71 | 128 | 65 | -1 | 137 |
| N.S. | 1 | 1.00 | 1.12 | 1.78 | 1.61 | 1.73 | 3.12 | 1.59 | -0.02 | 3.34 |
| time (sec) |
N/A | 0.004 | 0.052 | 0.163 | 0.356 | 0.296 | 2.057 | 0.008 | 0.000 | 4.146 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 20 | 30 | 38 | 37 | 66 | 41 | 32 | 66 |
| N.S. | 1 | 1.00 | 1.00 | 1.50 | 1.90 | 1.85 | 3.30 | 2.05 | 1.60 | 3.30 |
| time (sec) |
N/A | 0.001 | 0.045 | 0.163 | 0.263 | 0.291 | 0.948 | 0.007 | 0.263 | 2.929 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 23 | 30 | 38 | 38 | 66 | 47 | 33 | 68 |
| N.S. | 1 | 1.00 | 0.56 | 0.73 | 0.93 | 0.93 | 1.61 | 1.15 | 0.80 | 1.66 |
| time (sec) |
N/A | 0.003 | 0.037 | 0.156 | 0.345 | 0.296 | 1.371 | 0.004 | 0.310 | 3.421 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 30 | 43 | 38 | 49 | 167 | 111 | 48 | 133 |
| N.S. | 1 | 1.00 | 0.52 | 0.74 | 0.66 | 0.84 | 2.88 | 1.91 | 0.83 | 2.29 |
| time (sec) |
N/A | 0.006 | 0.048 | 0.160 | 0.263 | 0.297 | 3.486 | 0.005 | 0.338 | 5.456 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 24 | 57 | 25 | 35 | 280 | 197 | 41 | 199 |
| N.S. | 1 | 1.00 | 0.56 | 1.33 | 0.58 | 0.81 | 6.51 | 4.58 | 0.95 | 4.63 |
| time (sec) |
N/A | 0.003 | 0.040 | 0.154 | 0.272 | 0.290 | 6.713 | 0.007 | 0.365 | 8.559 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 63 | 63 | 40 | 72 | 52 | 84 | 425 | 269 | 75 | 285 |
| N.S. | 1 | 1.00 | 0.63 | 1.14 | 0.83 | 1.33 | 6.75 | 4.27 | 1.19 | 4.52 |
| time (sec) |
N/A | 0.006 | 0.059 | 0.157 | 0.263 | 0.294 | 23.860 | 0.012 | 0.377 | 22.168 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 83 | 83 | 45 | 86 | 91 | 101 | 593 | 341 | 86 | 388 |
| N.S. | 1 | 1.00 | 0.54 | 1.04 | 1.10 | 1.22 | 7.14 | 4.11 | 1.04 | 4.67 |
| time (sec) |
N/A | 0.010 | 0.065 | 0.164 | 0.271 | 0.297 | 71.344 | 0.017 | 0.413 | 56.745 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-1) | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 103 | 103 | 50 | 100 | 146 | 114 | 0 | 414 | 99 | 495 |
| N.S. |
1 | 1.00 | 0.49 | 0.97 | 1.42 | 1.11 | 0.00 | 4.02 | 0.96 | 4.81 |
| time (sec) |
N/A | 0.014 | 0.068 | 0.161 | 0.264 | 0.304 | 0.000 | 0.025 | 0.423 | 167.482 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | F | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 126 | 126 | 86 | 198 | 72 | 201 | 0 | 1165 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 1.57 | 0.57 | 1.60 | 0.00 | 9.25 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.039 | 0.226 | 0.186 | 0.360 | 0.303 | 0.000 | 0.113 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | F | B | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 96 | 96 | 79 | 150 | 50 | 155 | 0 | 623 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.82 | 1.56 | 0.52 | 1.61 | 0.00 | 6.49 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.026 | 0.162 | 0.178 | 0.334 | 0.307 | 0.000 | 0.065 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 69 | 102 | 28 | 127 | 0 | 231 | 59 | 0 |
| N.S. |
1 | 1.00 | 1.03 | 1.52 | 0.42 | 1.90 | 0.00 | 3.45 | 0.88 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.162 | 0.139 | 0.357 | 0.309 | 0.000 | 0.025 | 0.300 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 47 | 57 | 8 | 101 | 85 | 62 | 44 | 63 |
| N.S. | 1 | 1.00 | 1.09 | 1.33 | 0.19 | 2.35 | 1.98 | 1.44 | 1.02 | 1.47 |
| time (sec) |
N/A | 0.017 | 0.044 | 0.137 | 0.355 | 0.304 | 13.199 | 0.009 | 0.175 | 15.525 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 27 | 27 | 27 | 47 | 21 | 39 | 82 | 131 | 23 | 63 |
| N.S. | 1 | 1.00 | 1.00 | 1.74 | 0.78 | 1.44 | 3.04 | 4.85 | 0.85 | 2.33 |
| time (sec) |
N/A | 0.003 | 0.059 | 0.143 | 0.284 | 0.291 | 2.247 | 0.011 | 0.391 | 4.447 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 42 | 105 | 45 | 57 | 82 | 303 | 62 | 63 |
| N.S. | 1 | 1.00 | 0.69 | 1.72 | 0.74 | 0.93 | 1.34 | 4.97 | 1.02 | 1.03 |
| time (sec) |
N/A | 0.007 | 0.072 | 0.141 | 0.277 | 0.293 | 8.481 | 0.035 | 0.415 | 9.619 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 91 | 91 | 49 | 163 | 67 | 74 | 85 | 459 | 50 | 63 |
| N.S. | 1 | 1.00 | 0.54 | 1.79 | 0.74 | 0.81 | 0.93 | 5.04 | 0.55 | 0.69 |
| time (sec) |
N/A | 0.012 | 0.079 | 0.157 | 0.268 | 0.298 | 46.539 | 0.072 | 0.442 | 38.959 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | F(-1) | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 121 | 121 | 54 | 221 | 89 | 89 | 0 | 607 | 66 | 63 |
| N.S. |
1 | 1.00 | 0.45 | 1.83 | 0.74 | 0.74 | 0.00 | 5.02 | 0.55 | 0.52 |
| time (sec) |
N/A | 0.020 | 0.086 | 0.137 | 0.281 | 0.302 | 0.000 | 0.180 | 0.478 | 188.872 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | F | B | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 135 | 135 | 103 | 242 | 89 | 232 | 0 | 951 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.76 | 1.79 | 0.66 | 1.72 | 0.00 | 7.04 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.037 | 0.167 | 0.161 | 0.360 | 0.315 | 0.000 | 0.107 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | F | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 102 | 102 | 92 | 184 | 63 | 193 | 0 | 516 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.90 | 1.80 | 0.62 | 1.89 | 0.00 | 5.06 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.025 | 0.123 | 0.172 | 0.364 | 0.307 | 0.000 | 0.058 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 68 | 68 | 78 | 126 | 39 | 159 | 0 | 199 | 72 | 0 |
| N.S. |
1 | 1.00 | 1.15 | 1.85 | 0.57 | 2.34 | 0.00 | 2.93 | 1.06 | 0.00 |
| time (sec) |
N/A | 0.019 | 0.071 | 0.176 | 0.358 | 0.321 | 0.000 | 0.023 | 0.203 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 48 | 71 | 14 | 108 | 90 | 49 | 53 | 76 |
| N.S. | 1 | 1.00 | 1.26 | 1.87 | 0.37 | 2.84 | 2.37 | 1.29 | 1.39 | 2.00 |
| time (sec) |
N/A | 0.014 | 0.044 | 0.189 | 0.345 | 0.307 | 13.413 | 0.009 | 0.177 | 15.774 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 29 | 59 | 25 | 45 | 94 | 112 | 26 | 79 |
| N.S. | 1 | 1.00 | 0.97 | 1.97 | 0.83 | 1.50 | 3.13 | 3.73 | 0.87 | 2.63 |
| time (sec) |
N/A | 0.003 | 0.059 | 0.149 | 0.291 | 0.290 | 2.514 | 0.011 | 0.497 | 4.893 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 46 | 129 | 53 | 72 | 94 | 256 | 80 | 79 |
| N.S. | 1 | 1.00 | 0.69 | 1.93 | 0.79 | 1.07 | 1.40 | 3.82 | 1.19 | 1.18 |
| time (sec) |
N/A | 0.007 | 0.071 | 0.145 | 0.269 | 0.297 | 9.477 | 0.030 | 0.584 | 10.811 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 57 | 202 | 79 | 98 | 97 | 389 | 111 | 79 |
| N.S. | 1 | 1.00 | 0.57 | 2.02 | 0.79 | 0.98 | 0.97 | 3.89 | 1.11 | 0.79 |
| time (sec) |
N/A | 0.014 | 0.080 | 0.167 | 0.284 | 0.307 | 48.593 | 0.070 | 0.650 | 41.016 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | F(-1) | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 133 | 133 | 76 | 275 | 105 | 122 | 0 | 521 | 170 | 79 |
| N.S. |
1 | 1.00 | 0.57 | 2.07 | 0.79 | 0.92 | 0.00 | 3.92 | 1.28 | 0.59 |
| time (sec) |
N/A | 0.022 | 0.091 | 0.151 | 0.266 | 0.332 | 0.000 | 0.148 | 0.714 | 190.343 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-1) | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 193 | 134 | 46 | 65 | 0 | 690 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.93 | 1.34 | 0.46 | 0.65 | 0.00 | 6.90 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.014 | 1.107 | 0.175 | 0.347 | 0.303 | 0.000 | 0.044 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | A | A | F(-1) | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 179 | 102 | 34 | 60 | 0 | 358 | -1 | 0 |
| N.S. |
1 | 1.00 | 2.42 | 1.38 | 0.46 | 0.81 | 0.00 | 4.84 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.809 | 0.144 | 0.386 | 0.290 | 0.000 | 0.024 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 108 | 70 | 22 | 52 | 187 | 125 | 44 | 129 |
| N.S. | 1 | 1.00 | 2.51 | 1.63 | 0.51 | 1.21 | 4.35 | 2.91 | 1.02 | 3.00 |
| time (sec) |
N/A | 0.004 | 0.659 | 0.183 | 0.351 | 0.297 | 2.150 | 0.006 | 0.256 | 4.327 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 13 | 13 | 27 | 37 | 9 | 28 | 41 | 32 | 40 | 38 |
| N.S. | 1 | 1.00 | 2.08 | 2.85 | 0.69 | 2.15 | 3.15 | 2.46 | 3.08 | 2.92 |
| time (sec) |
N/A | 0.002 | 0.043 | 0.161 | 0.346 | 0.298 | 1.060 | 0.002 | 0.051 | 2.798 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 59 | 34 | 12 | 26 | 156 | 112 | 24 | 90 |
| N.S. | 1 | 1.00 | 2.11 | 1.21 | 0.43 | 0.93 | 5.57 | 4.00 | 0.86 | 3.21 |
| time (sec) |
N/A | 0.002 | 0.686 | 0.151 | 0.266 | 0.292 | 44.735 | 0.004 | 0.461 | 37.423 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-2) | B | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 107 | 66 | 25 | 39 | 0 | 232 | 49 | 0 |
| N.S. |
1 | 1.00 | 1.88 | 1.16 | 0.44 | 0.68 | 0.00 | 4.07 | 0.86 | 0.00 |
| time (sec) |
N/A | 0.004 | 0.803 | 0.148 | 0.259 | 0.293 | 0.000 | 0.008 | 0.311 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 85 | 85 | 149 | 98 | 37 | 49 | 0 | 339 | 66 | 0 |
| N.S. |
1 | 1.00 | 1.75 | 1.15 | 0.44 | 0.58 | 0.00 | 3.99 | 0.78 | 0.00 |
| time (sec) |
N/A | 0.008 | 1.052 | 0.138 | 0.266 | 0.291 | 0.000 | 0.015 | 0.452 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 91 | 91 | 82 | 89 | 67 | 62 | 199 | 275 | -1 | 144 |
| N.S. | 1 | 1.00 | 0.90 | 0.98 | 0.74 | 0.68 | 2.19 | 3.02 | -0.01 | 1.58 |
| time (sec) |
N/A | 0.017 | 0.084 | 0.164 | 0.379 | 0.298 | 12.089 | 0.015 | 0.000 | 13.978 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 72 | 61 | 38 | 52 | 124 | 93 | 41 | 100 |
| N.S. | 1 | 1.00 | 1.41 | 1.20 | 0.75 | 1.02 | 2.43 | 1.82 | 0.80 | 1.96 |
| time (sec) |
N/A | 0.008 | 0.054 | 0.170 | 0.351 | 0.300 | 1.878 | 0.005 | 0.207 | 4.015 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | A | B | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 8 | 8 | 44 | 31 | 6 | 32 | 26 | 12 | 31 | 25 |
| N.S. | 1 | 1.00 | 5.50 | 3.88 | 0.75 | 4.00 | 3.25 | 1.50 | 3.88 | 3.12 |
| time (sec) |
N/A | 0.003 | 0.028 | 0.167 | 0.340 | 0.297 | 0.788 | 0.002 | 0.178 | 2.560 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 37 | 37 | 21 | 30 | 30 | 29 | 100 | 71 | 32 | 78 |
| N.S. | 1 | 1.00 | 0.57 | 0.81 | 0.81 | 0.78 | 2.70 | 1.92 | 0.86 | 2.11 |
| time (sec) |
N/A | 0.003 | 0.032 | 0.161 | 0.266 | 0.301 | 1.283 | 0.004 | 0.255 | 3.253 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 79 | 79 | 43 | 58 | 59 | 49 | 282 | 173 | 69 | 206 |
| N.S. | 1 | 1.00 | 0.54 | 0.73 | 0.75 | 0.62 | 3.57 | 2.19 | 0.87 | 2.61 |
| time (sec) |
N/A | 0.010 | 0.043 | 0.167 | 0.271 | 0.307 | 7.052 | 0.007 | 0.370 | 8.753 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 16 | 30 | 12 | 22 | 71 | 87 | 22 | 66 |
| N.S. | 1 | 1.00 | 0.76 | 1.43 | 0.57 | 1.05 | 3.38 | 4.14 | 1.05 | 3.14 |
| time (sec) |
N/A | 0.001 | 0.032 | 0.163 | 0.292 | 0.295 | 0.990 | 0.003 | 0.364 | 3.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 24 | 24 | 19 | 42 | 15 | 29 | 73 | 103 | 26 | 69 |
| N.S. | 1 | 1.00 | 0.79 | 1.75 | 0.62 | 1.21 | 3.04 | 4.29 | 1.08 | 2.88 |
| time (sec) |
N/A | 0.002 | 0.040 | 0.149 | 0.258 | 0.292 | 2.396 | 0.004 | 0.463 | 4.266 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 26 | 26 | 21 | 30 | 12 | 22 | 92 | 92 | 22 | 75 |
| N.S. | 1 | 1.00 | 0.81 | 1.15 | 0.46 | 0.85 | 3.54 | 3.54 | 0.85 | 2.88 |
| time (sec) |
N/A | 0.001 | 0.090 | 0.141 | 0.273 | 0.289 | 9.941 | 0.003 | 0.374 | 10.338 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 19 | 42 | 15 | 29 | 83 | 108 | 26 | 72 |
| N.S. | 1 | 1.00 | 0.66 | 1.45 | 0.52 | 1.00 | 2.86 | 3.72 | 0.90 | 2.48 |
| time (sec) |
N/A | 0.002 | 0.155 | 0.179 | 0.289 | 0.292 | 12.053 | 0.003 | 0.321 | 12.461 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 39 | 39 | 39 | 76 | 39 | 108 | 88 | 47 | 56 | 76 |
| N.S. | 1 | 1.00 | 1.00 | 1.95 | 1.00 | 2.77 | 2.26 | 1.21 | 1.44 | 1.95 |
| time (sec) |
N/A | 0.018 | 0.064 | 0.168 | 0.278 | 0.307 | 13.178 | 0.009 | 0.218 | 15.369 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 241 | 241 | 42 | 0 | 0 | 452 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.17 | 0.00 | 0.00 | 1.88 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.190 | 0.086 | 0.055 | 0.000 | 0.312 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 144 | 144 | 70 | 104 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.49 | 0.72 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.025 | 10.038 | 0.224 | 0.000 | 0.304 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 106 | 106 | 70 | 94 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.66 | 0.89 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 10.019 | 0.169 | 0.000 | 0.322 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | A | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 71 | 71 | 70 | 0 | 0 | 0 | 102 | 0 | -1 | 74 |
| N.S. | 1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 1.44 | 0.00 | -0.01 | 1.04 |
| time (sec) |
N/A | 0.009 | 10.023 | 0.050 | 0.000 | 0.311 | 1.950 | 0.000 | 0.000 | 3.938 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 78 | 78 | 68 | 94 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.87 | 1.21 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.012 | 10.021 | 0.169 | 0.000 | 0.309 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 70 | 105 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.85 | 1.28 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.012 | 10.026 | 0.184 | 0.000 | 0.305 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 115 | 115 | 70 | 113 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.61 | 0.98 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.018 | 10.031 | 0.175 | 0.000 | 0.303 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 148 | 148 | 70 | 114 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.47 | 0.77 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.027 | 10.024 | 0.201 | 0.000 | 0.310 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | C | F | A | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 256 | 256 | 111 | 479 | 0 | 194 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.43 | 1.87 | 0.00 | 0.76 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.125 | 0.346 | 1.432 | 0.000 | 0.306 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | A | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 233 | 233 | 77 | 0 | 0 | 221 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.33 | 0.00 | 0.00 | 0.95 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.098 | 0.148 | 0.050 | 0.000 | 0.317 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 33 | 33 | 33 | 31 | 0 | 31 | 0 | 0 | 38 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.94 | 0.00 | 0.94 | 0.00 | 0.00 | 1.15 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.077 | 0.159 | 0.000 | 0.294 | 0.000 | 0.000 | 0.549 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 45 | 44 | 0 | 44 | 0 | 0 | 46 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 0.66 | 0.00 | 0.66 | 0.00 | 0.00 | 0.69 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.083 | 0.146 | 0.000 | 0.311 | 0.000 | 0.000 | 0.666 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-2) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 52 | 50 | 0 | 57 | 0 | 0 | 51 | 0 |
| N.S. |
1 | 1.00 | 0.52 | 0.50 | 0.00 | 0.57 | 0.00 | 0.00 | 0.51 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.089 | 0.162 | 0.000 | 0.304 | 0.000 | 0.000 | 0.752 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-2) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 133 | 133 | 57 | 55 | 0 | 68 | 0 | 0 | 57 | 0 |
| N.S. |
1 | 1.00 | 0.43 | 0.41 | 0.00 | 0.51 | 0.00 | 0.00 | 0.43 | 0.00 |
| time (sec) |
N/A | 0.020 | 0.094 | 0.170 | 0.000 | 0.302 | 0.000 | 0.000 | 0.794 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | C | F | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 256 | 256 | 111 | 465 | 0 | 198 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.43 | 1.82 | 0.00 | 0.77 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.108 | 0.407 | 1.604 | 0.000 | 0.305 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | A | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 233 | 233 | 77 | 0 | 0 | 221 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.33 | 0.00 | 0.00 | 0.95 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.096 | 0.116 | 0.053 | 0.000 | 0.307 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 31 | 31 | 31 | 31 | 0 | 31 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 1.00 | 0.00 | 1.00 | 0.00 | 0.00 | -0.03 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.041 | 0.160 | 0.000 | 0.298 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 45 | 44 | 0 | 44 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 0.66 | 0.00 | 0.66 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.076 | 0.151 | 0.000 | 0.299 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-1) | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 52 | 50 | 0 | 57 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.52 | 0.50 | 0.00 | 0.57 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.079 | 0.159 | 0.000 | 0.298 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 112 | 112 | 70 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.62 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 10.021 | 0.013 | 0.000 | 0.304 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 76 | 76 | 70 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.92 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.011 | 10.022 | 0.009 | 0.000 | 0.301 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | A | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 68 | 0 | 0 | 0 | 100 | 0 | -1 | 73 |
| N.S. | 1 | 1.00 | 1.58 | 0.00 | 0.00 | 0.00 | 2.33 | 0.00 | -0.02 | 1.70 |
| time (sec) |
N/A | 0.006 | 10.020 | 0.045 | 0.000 | 0.313 | 2.559 | 0.000 | 0.000 | 4.476 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 70 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.85 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.011 | 10.017 | 0.020 | 0.000 | 0.303 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 115 | 115 | 70 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.61 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 10.036 | 0.019 | 0.000 | 0.303 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | C | F | A | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 291 | 291 | 121 | 465 | 0 | 235 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.42 | 1.60 | 0.00 | 0.81 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.122 | 0.644 | 1.608 | 0.000 | 0.306 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | C | F | A | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 266 | 266 | 112 | 455 | 0 | 298 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.42 | 1.71 | 0.00 | 1.12 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.096 | 0.192 | 1.305 | 0.000 | 0.315 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 33 | 33 | 33 | 31 | 0 | 31 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.94 | 0.00 | 0.94 | 0.00 | 0.00 | -0.03 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.054 | 0.153 | 0.000 | 0.298 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 45 | 33 | 0 | 36 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.69 | 0.51 | 0.00 | 0.55 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.074 | 0.147 | 0.000 | 0.294 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 52 | 44 | 0 | 56 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.52 | 0.44 | 0.00 | 0.56 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.080 | 0.153 | 0.000 | 0.300 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 139 | 139 | 70 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.50 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.024 | 10.037 | 0.016 | 0.000 | 0.309 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 113 | 113 | 70 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.62 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 10.026 | 0.014 | 0.000 | 0.313 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 79 | 79 | 70 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.89 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.011 | 10.029 | 0.015 | 0.000 | 0.321 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 68 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.83 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.011 | 10.015 | 0.017 | 0.000 | 0.302 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | A | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 70 | 0 | 0 | 0 | 95 | 0 | -1 | 74 |
| N.S. | 1 | 1.00 | 0.86 | 0.00 | 0.00 | 0.00 | 1.17 | 0.00 | -0.01 | 0.91 |
| time (sec) |
N/A | 0.011 | 10.017 | 0.014 | 0.000 | 0.303 | 26.799 | 0.000 | 0.000 | 23.104 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F(-2) | F | F(-1) | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 114 | 114 | 70 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.61 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 10.020 | 0.019 | 0.000 | 0.318 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F(-2) | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 147 | 147 | 70 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.48 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.025 | 10.027 | 0.022 | 0.000 | 0.310 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 137 | 137 | 70 | 96 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.51 | 0.70 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.023 | 10.023 | 0.167 | 0.000 | 0.308 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 102 | 102 | 70 | 88 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.69 | 0.86 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.025 | 0.167 | 0.000 | 0.306 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 78 | 78 | 70 | 94 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.90 | 1.21 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.012 | 10.017 | 0.173 | 0.000 | 0.313 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F | F | A | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 46 | 46 | 68 | 91 | 0 | 0 | 97 | 0 | -1 | 72 |
| N.S. | 1 | 1.00 | 1.48 | 1.98 | 0.00 | 0.00 | 2.11 | 0.00 | -0.02 | 1.57 |
| time (sec) |
N/A | 0.006 | 10.018 | 0.199 | 0.000 | 0.304 | 6.481 | 0.000 | 0.000 | 7.735 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F(-2) | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 70 | 107 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.85 | 1.30 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.011 | 10.021 | 0.179 | 0.000 | 0.307 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F(-2) | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 115 | 115 | 70 | 113 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.61 | 0.98 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.018 | 10.021 | 0.181 | 0.000 | 0.304 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | C | F | A | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 287 | 287 | 117 | 480 | 0 | 233 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.41 | 1.67 | 0.00 | 0.81 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.121 | 0.542 | 1.569 | 0.000 | 0.302 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | C | F | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 264 | 264 | 109 | 478 | 0 | 296 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.41 | 1.81 | 0.00 | 1.12 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.093 | 0.187 | 1.149 | 0.000 | 0.316 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 31 | 31 | 31 | 31 | 0 | 31 | 0 | 0 | 27 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 1.00 | 0.00 | 1.00 | 0.00 | 0.00 | 0.87 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.045 | 0.184 | 0.000 | 0.296 | 0.000 | 0.000 | 1.161 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 45 | 33 | 0 | 36 | 0 | 0 | 40 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 0.49 | 0.00 | 0.54 | 0.00 | 0.00 | 0.60 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.096 | 0.149 | 0.000 | 0.299 | 0.000 | 0.000 | 0.597 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 52 | 44 | 0 | 56 | 0 | 0 | 46 | 0 |
| N.S. |
1 | 1.00 | 0.52 | 0.44 | 0.00 | 0.56 | 0.00 | 0.00 | 0.46 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.104 | 0.150 | 0.000 | 0.296 | 0.000 | 0.000 | 0.764 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 141 | 141 | 70 | 101 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.50 | 0.72 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.022 | 10.032 | 0.177 | 0.000 | 0.311 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 115 | 115 | 70 | 107 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.61 | 0.93 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.018 | 10.024 | 0.211 | 0.000 | 0.308 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 70 | 105 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.85 | 1.28 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.012 | 10.017 | 0.196 | 0.000 | 0.309 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F(-2) | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 68 | 107 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.83 | 1.30 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.018 | 10.037 | 0.201 | 0.000 | 0.306 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | A | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 88 | 88 | 70 | 0 | 0 | 0 | 95 | 0 | -1 | 74 |
| N.S. | 1 | 1.00 | 0.80 | 0.00 | 0.00 | 0.00 | 1.08 | 0.00 | -0.01 | 0.84 |
| time (sec) |
N/A | 0.012 | 10.024 | 0.067 | 0.000 | 0.304 | 125.792 | 0.000 | 0.000 | 94.497 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F(-2) | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 121 | 121 | 70 | 124 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.58 | 1.02 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.020 | 10.029 | 0.208 | 0.000 | 0.315 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | C | F(-2) | F | F(-1) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 154 | 154 | 70 | 130 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.45 | 0.84 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.029 | 10.024 | 0.214 | 0.000 | 0.312 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | C | F | A | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 297 | 297 | 127 | 490 | 0 | 343 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.43 | 1.65 | 0.00 | 1.15 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.100 | 0.287 | 1.345 | 0.000 | 0.310 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F | A | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 33 | 33 | 33 | 50 | 0 | 42 | 0 | 0 | 38 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 1.52 | 0.00 | 1.27 | 0.00 | 0.00 | 1.15 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.079 | 0.147 | 0.000 | 0.297 | 0.000 | 0.000 | 0.546 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 45 | 44 | 0 | 44 | 0 | 0 | 38 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 0.66 | 0.00 | 0.66 | 0.00 | 0.00 | 0.57 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.097 | 0.167 | 0.000 | 0.292 | 0.000 | 0.000 | 0.633 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 52 | 44 | 0 | 56 | 0 | 0 | 45 | 0 |
| N.S. |
1 | 1.00 | 0.52 | 0.44 | 0.00 | 0.56 | 0.00 | 0.00 | 0.45 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.101 | 0.154 | 0.000 | 0.297 | 0.000 | 0.000 | 0.535 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-2) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 133 | 133 | 64 | 56 | 0 | 54 | 0 | 0 | 56 | 0 |
| N.S. |
1 | 1.00 | 0.48 | 0.42 | 0.00 | 0.41 | 0.00 | 0.00 | 0.42 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.106 | 0.165 | 0.000 | 0.311 | 0.000 | 0.000 | 0.687 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 83 | 83 | 77 | 103 | 167 | 128 | 819 | 282 | 133 | 693 |
| N.S. | 1 | 1.00 | 0.93 | 1.24 | 2.01 | 1.54 | 9.87 | 3.40 | 1.60 | 8.35 |
| time (sec) |
N/A | 0.021 | 0.058 | 0.174 | 0.269 | 0.300 | 0.442 | 0.004 | 0.493 | 4.952 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 53 | 53 | 43 | 47 | 81 | 58 | 245 | 113 | 66 | 256 |
| N.S. | 1 | 1.00 | 0.81 | 0.89 | 1.53 | 1.09 | 4.62 | 2.13 | 1.25 | 4.83 |
| time (sec) |
N/A | 0.013 | 0.044 | 0.123 | 0.269 | 0.310 | 0.277 | 0.004 | 0.319 | 2.803 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 52 | 52 | 52 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.011 | 0.039 | 0.058 | 0.000 | 0.299 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 52 | 52 | 52 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.033 | 0.059 | 0.000 | 0.304 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 41 | 41 | 53 | 0 | 0 | 0 | 124 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.29 | 0.00 | 0.00 | 0.00 | 3.02 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.063 | 0.082 | 0.000 | 0.309 | 2.068 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 72 | 0 | 0 | 0 | 146 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.26 | 0.00 | 0.00 | 0.00 | 2.56 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.038 | 0.063 | 0.000 | 0.304 | 2.739 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 20 | 0 | 0 | 0 | 42 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 2.10 | 0.00 | -0.05 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.051 | 0.057 | 0.000 | 0.299 | 2.284 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 84 | 97 | 96 | 96 | 100 | 109 | 88 | 85 |
| N.S. | 1 | 1.00 | 2.21 | 2.55 | 2.53 | 2.53 | 2.63 | 2.87 | 2.32 | 2.24 |
| time (sec) |
N/A | 0.011 | 0.011 | 0.116 | 0.280 | 0.288 | 0.040 | 0.001 | 0.190 | 2.128 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 67 | 73 | 69 | 69 | 73 | 82 | 65 | 60 |
| N.S. | 1 | 1.00 | 1.76 | 1.92 | 1.82 | 1.82 | 1.92 | 2.16 | 1.71 | 1.58 |
| time (sec) |
N/A | 0.010 | 0.008 | 0.117 | 0.263 | 0.289 | 0.037 | 0.001 | 0.159 | 2.011 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 46 | 49 | 48 | 48 | 49 | 57 | 47 | 43 |
| N.S. | 1 | 1.00 | 1.21 | 1.29 | 1.26 | 1.26 | 1.29 | 1.50 | 1.24 | 1.13 |
| time (sec) |
N/A | 0.021 | 0.005 | 0.122 | 0.257 | 0.283 | 0.035 | 0.000 | 0.047 | 1.810 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 28 | 25 | 24 | 26 | 26 | 32 | 25 | 23 |
| N.S. | 1 | 1.00 | 1.00 | 0.89 | 0.86 | 0.93 | 0.93 | 1.14 | 0.89 | 0.82 |
| time (sec) |
N/A | 0.012 | 0.003 | 0.011 | 0.264 | 0.259 | 0.029 | 0.001 | 0.035 | 1.700 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 12 | 12 | 12 | 11 | 10 | 10 | 8 | 11 | 10 | 10 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.83 | 0.83 | 0.67 | 0.92 | 0.83 | 0.83 |
| time (sec) |
N/A | 0.002 | 0.000 | 0.010 | 0.313 | 0.261 | 0.026 | 0.000 | 0.019 | 1.544 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 25 | 25 | 25 | 26 | 25 | 24 | 20 | 26 | 26 | 25 |
| N.S. | 1 | 1.00 | 1.00 | 1.04 | 1.00 | 0.96 | 0.80 | 1.04 | 1.04 | 1.00 |
| time (sec) |
N/A | 0.013 | 0.006 | 0.124 | 0.271 | 0.285 | 0.084 | 0.000 | 0.049 | 1.709 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 31 | 33 | 35 | 39 | 27 | 33 | 31 | 32 |
| N.S. | 1 | 1.00 | 0.97 | 1.03 | 1.09 | 1.22 | 0.84 | 1.03 | 0.97 | 1.00 |
| time (sec) |
N/A | 0.015 | 0.008 | 0.128 | 0.278 | 0.286 | 0.108 | 0.001 | 0.171 | 1.859 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 26 | 35 | 38 | 38 | 39 | 29 | 39 | 37 |
| N.S. | 1 | 1.00 | 0.93 | 1.25 | 1.36 | 1.36 | 1.39 | 1.04 | 1.39 | 1.32 |
| time (sec) |
N/A | 0.004 | 0.008 | 0.117 | 0.271 | 0.298 | 0.151 | 0.001 | 0.159 | 1.857 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 27 | 35 | 50 | 50 | 53 | 30 | 52 | 48 |
| N.S. | 1 | 1.00 | 0.71 | 0.92 | 1.32 | 1.32 | 1.39 | 0.79 | 1.37 | 1.26 |
| time (sec) |
N/A | 0.016 | 0.006 | 0.126 | 0.288 | 0.289 | 0.195 | 0.001 | 0.165 | 2.035 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 27 | 35 | 61 | 61 | 65 | 30 | 63 | 59 |
| N.S. | 1 | 1.00 | 0.71 | 0.92 | 1.61 | 1.61 | 1.71 | 0.79 | 1.66 | 1.55 |
| time (sec) |
N/A | 0.015 | 0.006 | 0.123 | 0.280 | 0.284 | 0.248 | 0.001 | 0.041 | 2.123 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 148 | 163 | 156 | 156 | 168 | 186 | 144 | 139 |
| N.S. | 1 | 1.00 | 2.28 | 2.51 | 2.40 | 2.40 | 2.58 | 2.86 | 2.22 | 2.14 |
| time (sec) |
N/A | 0.065 | 0.020 | 0.133 | 0.276 | 0.284 | 0.048 | 0.000 | 0.066 | 2.605 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 122 | 125 | 124 | 124 | 133 | 146 | 115 | 111 |
| N.S. | 1 | 1.00 | 1.88 | 1.92 | 1.91 | 1.91 | 2.05 | 2.25 | 1.77 | 1.71 |
| time (sec) |
N/A | 0.047 | 0.010 | 0.132 | 0.261 | 0.293 | 0.044 | 0.000 | 0.050 | 2.322 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 79 | 87 | 81 | 81 | 87 | 101 | 74 | 72 |
| N.S. | 1 | 1.00 | 1.22 | 1.34 | 1.25 | 1.25 | 1.34 | 1.55 | 1.14 | 1.11 |
| time (sec) |
N/A | 0.035 | 0.007 | 0.135 | 0.286 | 0.288 | 0.040 | 0.000 | 0.166 | 2.079 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 47 | 49 | 48 | 48 | 49 | 57 | 47 | 43 |
| N.S. | 1 | 1.00 | 1.24 | 1.29 | 1.26 | 1.26 | 1.29 | 1.50 | 1.24 | 1.13 |
| time (sec) |
N/A | 0.022 | 0.006 | 0.115 | 0.280 | 0.285 | 0.034 | 0.000 | 0.044 | 1.777 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 20 | 20 | 19 | 12 | 20 | 18 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 1.43 | 1.43 | 1.36 | 0.86 | 1.43 | 1.29 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.120 | 0.315 | 0.282 | 0.031 | 0.000 | 0.028 | 1.605 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 49 | 49 | 43 | 56 | 61 | 63 | 44 | 65 | 62 | 46 |
| N.S. | 1 | 1.00 | 0.88 | 1.14 | 1.24 | 1.29 | 0.90 | 1.33 | 1.27 | 0.94 |
| time (sec) |
N/A | 0.014 | 0.012 | 0.168 | 0.264 | 0.294 | 0.133 | 0.000 | 0.190 | 1.950 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 47 | 63 | 67 | 92 | 60 | 69 | 71 | 67 |
| N.S. | 1 | 1.00 | 0.92 | 1.24 | 1.31 | 1.80 | 1.18 | 1.35 | 1.39 | 1.31 |
| time (sec) |
N/A | 0.025 | 0.025 | 0.139 | 0.264 | 0.291 | 0.203 | 0.000 | 0.200 | 2.151 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 59 | 59 | 49 | 69 | 79 | 99 | 80 | 75 | 77 | 84 |
| N.S. | 1 | 1.00 | 0.83 | 1.17 | 1.34 | 1.68 | 1.36 | 1.27 | 1.31 | 1.42 |
| time (sec) |
N/A | 0.026 | 0.017 | 0.143 | 0.281 | 0.288 | 0.267 | 0.001 | 0.197 | 2.400 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 53 | 70 | 84 | 84 | 88 | 67 | 80 | 80 |
| N.S. | 1 | 1.00 | 1.89 | 2.50 | 3.00 | 3.00 | 3.14 | 2.39 | 2.86 | 2.86 |
| time (sec) |
N/A | 0.003 | 0.019 | 0.137 | 0.286 | 0.298 | 0.354 | 0.001 | 0.037 | 2.386 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 56 | 71 | 98 | 98 | 104 | 69 | 39 | 92 |
| N.S. | 1 | 1.00 | 0.86 | 1.09 | 1.51 | 1.51 | 1.60 | 1.06 | 0.60 | 1.42 |
| time (sec) |
N/A | 0.024 | 0.015 | 0.140 | 0.275 | 0.293 | 0.441 | 0.001 | 0.193 | 2.649 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 57 | 71 | 109 | 109 | 116 | 69 | 107 | 103 |
| N.S. | 1 | 1.00 | 0.88 | 1.09 | 1.68 | 1.68 | 1.78 | 1.06 | 1.65 | 1.58 |
| time (sec) |
N/A | 0.024 | 0.019 | 0.152 | 0.275 | 0.285 | 0.554 | 0.001 | 0.202 | 2.894 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 58 | 71 | 120 | 120 | 128 | 69 | 118 | 114 |
| N.S. | 1 | 1.00 | 0.89 | 1.09 | 1.85 | 1.85 | 1.97 | 1.06 | 1.82 | 1.75 |
| time (sec) |
N/A | 0.024 | 0.013 | 0.162 | 0.277 | 0.282 | 0.668 | 0.001 | 0.089 | 3.086 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 235 | 281 | 277 | 277 | 308 | 335 | 261 | 252 |
| N.S. | 1 | 1.00 | 2.55 | 3.05 | 3.01 | 3.01 | 3.35 | 3.64 | 2.84 | 2.74 |
| time (sec) |
N/A | 0.110 | 0.047 | 0.133 | 0.281 | 0.295 | 0.056 | 0.001 | 0.240 | 3.594 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 217 | 229 | 225 | 225 | 243 | 267 | 208 | 204 |
| N.S. | 1 | 1.00 | 2.36 | 2.49 | 2.45 | 2.45 | 2.64 | 2.90 | 2.26 | 2.22 |
| time (sec) |
N/A | 0.084 | 0.022 | 0.132 | 0.262 | 0.291 | 0.052 | 0.001 | 0.214 | 3.178 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 161 | 177 | 167 | 167 | 190 | 212 | 152 | 153 |
| N.S. | 1 | 1.00 | 1.75 | 1.92 | 1.82 | 1.82 | 2.07 | 2.30 | 1.65 | 1.66 |
| time (sec) |
N/A | 0.060 | 0.012 | 0.138 | 0.261 | 0.283 | 0.048 | 0.000 | 0.056 | 2.673 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 122 | 125 | 124 | 124 | 133 | 146 | 115 | 111 |
| N.S. | 1 | 1.00 | 1.88 | 1.92 | 1.91 | 1.91 | 2.05 | 2.25 | 1.77 | 1.71 |
| time (sec) |
N/A | 0.046 | 0.009 | 0.139 | 0.270 | 0.291 | 0.043 | 0.000 | 0.046 | 2.347 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 67 | 73 | 69 | 69 | 73 | 82 | 65 | 60 |
| N.S. | 1 | 1.00 | 1.76 | 1.92 | 1.82 | 1.82 | 1.92 | 2.16 | 1.71 | 1.58 |
| time (sec) |
N/A | 0.010 | 0.005 | 0.118 | 0.263 | 0.297 | 0.037 | 0.000 | 0.032 | 1.978 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 31 | 31 | 32 | 12 | 31 | 32 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 2.21 | 2.21 | 2.29 | 0.86 | 2.21 | 2.29 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.115 | 0.273 | 0.286 | 0.032 | 0.000 | 0.037 | 1.642 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 73 | 73 | 74 | 109 | 114 | 116 | 83 | 124 | 118 | 80 |
| N.S. | 1 | 1.00 | 1.01 | 1.49 | 1.56 | 1.59 | 1.14 | 1.70 | 1.62 | 1.10 |
| time (sec) |
N/A | 0.020 | 0.020 | 0.140 | 0.261 | 0.290 | 0.182 | 0.000 | 0.201 | 2.344 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 75 | 75 | 72 | 109 | 118 | 173 | 102 | 126 | 123 | 108 |
| N.S. | 1 | 1.00 | 0.96 | 1.45 | 1.57 | 2.31 | 1.36 | 1.68 | 1.64 | 1.44 |
| time (sec) |
N/A | 0.040 | 0.034 | 0.173 | 0.267 | 0.297 | 0.300 | 0.001 | 0.215 | 2.684 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 78 | 78 | 114 | 114 | 125 | 188 | 128 | 125 | 130 | 144 |
| N.S. | 1 | 1.00 | 1.46 | 1.46 | 1.60 | 2.41 | 1.64 | 1.60 | 1.67 | 1.85 |
| time (sec) |
N/A | 0.037 | 0.029 | 0.142 | 0.282 | 0.305 | 0.504 | 0.001 | 0.821 | 3.075 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 86 | 86 | 80 | 120 | 142 | 176 | 148 | 128 | 138 | 155 |
| N.S. | 1 | 1.00 | 0.93 | 1.40 | 1.65 | 2.05 | 1.72 | 1.49 | 1.60 | 1.80 |
| time (sec) |
N/A | 0.035 | 0.027 | 0.143 | 0.277 | 0.299 | 0.661 | 0.002 | 0.254 | 3.448 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 91 | 122 | 143 | 143 | 155 | 123 | 135 | 138 |
| N.S. | 1 | 1.00 | 3.25 | 4.36 | 5.11 | 5.11 | 5.54 | 4.39 | 4.82 | 4.93 |
| time (sec) |
N/A | 0.002 | 0.020 | 0.145 | 0.271 | 0.286 | 0.914 | 0.001 | 0.072 | 3.494 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 97 | 121 | 160 | 160 | 172 | 126 | 39 | 151 |
| N.S. | 1 | 1.00 | 1.67 | 2.09 | 2.76 | 2.76 | 2.97 | 2.17 | 0.67 | 2.60 |
| time (sec) |
N/A | 0.007 | 0.023 | 0.135 | 0.263 | 0.290 | 1.145 | 0.001 | 0.082 | 3.851 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 97 | 122 | 171 | 171 | 184 | 126 | 165 | 162 |
| N.S. | 1 | 1.00 | 1.05 | 1.33 | 1.86 | 1.86 | 2.00 | 1.37 | 1.79 | 1.76 |
| time (sec) |
N/A | 0.037 | 0.025 | 0.136 | 0.336 | 0.294 | 1.502 | 0.001 | 0.222 | 4.171 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 97 | 122 | 182 | 182 | 196 | 126 | 176 | 173 |
| N.S. | 1 | 1.00 | 1.05 | 1.33 | 1.98 | 1.98 | 2.13 | 1.37 | 1.91 | 1.88 |
| time (sec) |
N/A | 0.036 | 0.021 | 0.158 | 0.278 | 0.292 | 1.964 | 0.001 | 0.114 | 4.537 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 97 | 122 | 193 | 193 | 207 | 126 | 187 | 184 |
| N.S. | 1 | 1.00 | 1.05 | 1.33 | 2.10 | 2.10 | 2.25 | 1.37 | 2.03 | 2.00 |
| time (sec) |
N/A | 0.036 | 0.023 | 0.138 | 0.275 | 0.289 | 3.124 | 0.001 | 0.232 | 5.011 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 200 | 200 | 993 | 1033 | 1023 | 1023 | 1163 | 1269 | 997 | 964 |
| N.S. | 1 | 1.00 | 4.96 | 5.16 | 5.12 | 5.12 | 5.82 | 6.34 | 4.98 | 4.82 |
| time (sec) |
N/A | 0.462 | 0.091 | 0.137 | 0.285 | 0.304 | 0.111 | 0.001 | 0.554 | 9.565 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 200 | 200 | 897 | 925 | 921 | 921 | 1046 | 1140 | 892 | 862 |
| N.S. | 1 | 1.00 | 4.48 | 4.62 | 4.60 | 4.60 | 5.23 | 5.70 | 4.46 | 4.31 |
| time (sec) |
N/A | 0.387 | 0.061 | 0.154 | 0.269 | 0.301 | 0.103 | 0.001 | 0.357 | 8.569 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 200 | 200 | 785 | 817 | 807 | 807 | 935 | 1024 | 781 | 755 |
| N.S. | 1 | 1.00 | 3.92 | 4.08 | 4.04 | 4.04 | 4.68 | 5.12 | 3.90 | 3.78 |
| time (sec) |
N/A | 0.310 | 0.045 | 0.147 | 0.275 | 0.293 | 0.094 | 0.001 | 0.402 | 7.597 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 173 | 173 | 684 | 709 | 706 | 706 | 796 | 866 | 683 | 661 |
| N.S. | 1 | 1.00 | 3.95 | 4.10 | 4.08 | 4.08 | 4.60 | 5.01 | 3.95 | 3.82 |
| time (sec) |
N/A | 0.300 | 0.046 | 0.135 | 0.276 | 0.288 | 0.086 | 0.000 | 0.256 | 6.856 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 144 | 144 | 574 | 601 | 594 | 594 | 673 | 734 | 570 | 553 |
| N.S. | 1 | 1.00 | 3.99 | 4.17 | 4.12 | 4.12 | 4.67 | 5.10 | 3.96 | 3.84 |
| time (sec) |
N/A | 0.246 | 0.037 | 0.135 | 0.276 | 0.292 | 0.079 | 0.000 | 0.214 | 5.985 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 119 | 119 | 473 | 493 | 489 | 489 | 549 | 596 | 470 | 452 |
| N.S. | 1 | 1.00 | 3.97 | 4.14 | 4.11 | 4.11 | 4.61 | 5.01 | 3.95 | 3.80 |
| time (sec) |
N/A | 0.192 | 0.032 | 0.136 | 0.270 | 0.294 | 0.071 | 0.001 | 0.313 | 5.169 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 360 | 385 | 376 | 376 | 427 | 464 | 356 | 343 |
| N.S. | 1 | 1.00 | 3.91 | 4.18 | 4.09 | 4.09 | 4.64 | 5.04 | 3.87 | 3.73 |
| time (sec) |
N/A | 0.152 | 0.028 | 0.135 | 0.269 | 0.289 | 0.064 | 0.001 | 0.273 | 4.346 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 261 | 277 | 273 | 273 | 303 | 326 | 249 | 245 |
| N.S. | 1 | 1.00 | 4.02 | 4.26 | 4.20 | 4.20 | 4.66 | 5.02 | 3.83 | 3.77 |
| time (sec) |
N/A | 0.108 | 0.018 | 0.132 | 0.271 | 0.283 | 0.057 | 0.001 | 0.107 | 3.550 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 151 | 169 | 163 | 163 | 178 | 189 | 143 | 140 |
| N.S. | 1 | 1.00 | 3.97 | 4.45 | 4.29 | 4.29 | 4.68 | 4.97 | 3.76 | 3.68 |
| time (sec) |
N/A | 0.012 | 0.010 | 0.117 | 0.265 | 0.301 | 0.048 | 0.000 | 0.079 | 2.680 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 75 | 83 | 12 | 75 | 76 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 5.36 | 5.93 | 0.86 | 5.36 | 5.43 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.116 | 0.271 | 0.294 | 0.037 | 0.000 | 0.057 | 1.865 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 169 | 169 | 304 | 491 | 460 | 462 | 408 | 552 | 509 | 356 |
| N.S. | 1 | 1.00 | 1.80 | 2.91 | 2.72 | 2.73 | 2.41 | 3.27 | 3.01 | 2.11 |
| time (sec) |
N/A | 0.048 | 0.093 | 0.143 | 0.276 | 0.320 | 0.492 | 0.001 | 0.217 | 5.100 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 187 | 187 | 388 | 479 | 467 | 632 | 428 | 530 | 841 | 404 |
| N.S. | 1 | 1.00 | 2.07 | 2.56 | 2.50 | 3.38 | 2.29 | 2.83 | 4.50 | 2.16 |
| time (sec) |
N/A | 0.159 | 0.078 | 0.169 | 0.276 | 0.295 | 0.854 | 0.001 | 0.241 | 5.555 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 185 | 185 | 389 | 467 | 473 | 703 | 447 | 511 | 690 | 486 |
| N.S. | 1 | 1.00 | 2.10 | 2.52 | 2.56 | 3.80 | 2.42 | 2.76 | 3.73 | 2.63 |
| time (sec) |
N/A | 0.147 | 0.082 | 0.146 | 0.272 | 0.291 | 1.734 | 0.001 | 0.266 | 6.861 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 187 | 187 | 199 | 459 | 484 | 739 | 474 | 502 | 559 | 550 |
| N.S. | 1 | 1.00 | 1.06 | 2.45 | 2.59 | 3.95 | 2.53 | 2.68 | 2.99 | 2.94 |
| time (sec) |
N/A | 0.147 | 0.066 | 0.140 | 0.277 | 0.313 | 22.136 | 0.001 | 0.289 | 9.088 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F(-1) | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 187 | 187 | 173 | 453 | 494 | 754 | 0 | 499 | 512 | 593 |
| N.S. |
1 | 1.00 | 0.93 | 2.42 | 2.64 | 4.03 | 0.00 | 2.67 | 2.74 | 3.17 |
| time (sec) |
N/A | 0.132 | 0.070 | 0.145 | 0.300 | 0.298 | 0.000 | 0.001 | 0.772 | 19.493 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 181 | 181 | 389 | 451 | 504 | 732 | 0 | 493 | 508 | 612 |
| N.S. |
1 | 1.00 | 2.15 | 2.49 | 2.78 | 4.04 | 0.00 | 2.72 | 2.81 | 3.38 |
| time (sec) |
N/A | 0.125 | 0.093 | 0.179 | 0.313 | 0.293 | 0.000 | 0.001 | 0.339 | 66.680 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 186 | 186 | 390 | 456 | 516 | 692 | 0 | 492 | 517 | 610 |
| N.S. |
1 | 1.00 | 2.10 | 2.45 | 2.77 | 3.72 | 0.00 | 2.65 | 2.78 | 3.28 |
| time (sec) |
N/A | 0.113 | 0.126 | 0.147 | 0.315 | 0.292 | 0.000 | 0.001 | 0.369 | 236.591 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 194 | 194 | 308 | 462 | 534 | 624 | 0 | 494 | 461 | 0 |
| N.S. |
1 | 1.00 | 1.59 | 2.38 | 2.75 | 3.22 | 0.00 | 2.55 | 2.38 | 0.00 |
| time (sec) |
N/A | 0.106 | 0.100 | 0.147 | 0.279 | 0.304 | 0.000 | 0.001 | 0.353 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 353 | 464 | 509 | 509 | 0 | 527 | 571 | 0 |
| N.S. |
1 | 1.00 | 12.61 | 16.57 | 18.18 | 18.18 | 0.00 | 18.82 | 20.39 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.075 | 0.141 | 0.286 | 0.298 | 0.000 | 0.001 | 0.169 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 367 | 464 | 548 | 548 | 0 | 534 | 39 | 0 |
| N.S. |
1 | 1.00 | 6.33 | 8.00 | 9.45 | 9.45 | 0.00 | 9.21 | 0.67 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.075 | 0.177 | 0.298 | 0.287 | 0.000 | 0.001 | 0.146 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 89 | 89 | 371 | 464 | 559 | 559 | 0 | 534 | 600 | 0 |
| N.S. |
1 | 1.00 | 4.17 | 5.21 | 6.28 | 6.28 | 0.00 | 6.00 | 6.74 | 0.00 |
| time (sec) |
N/A | 0.015 | 0.076 | 0.143 | 0.281 | 0.292 | 0.000 | 0.001 | 0.446 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 120 | 120 | 369 | 464 | 570 | 570 | 0 | 534 | 548 | 0 |
| N.S. |
1 | 1.00 | 3.08 | 3.87 | 4.75 | 4.75 | 0.00 | 4.45 | 4.57 | 0.00 |
| time (sec) |
N/A | 0.023 | 0.077 | 0.141 | 0.300 | 0.302 | 0.000 | 0.001 | 0.518 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 151 | 151 | 371 | 464 | 581 | 581 | 0 | 534 | 559 | 0 |
| N.S. |
1 | 1.00 | 2.46 | 3.07 | 3.85 | 3.85 | 0.00 | 3.54 | 3.70 | 0.00 |
| time (sec) |
N/A | 0.034 | 0.075 | 0.145 | 0.297 | 0.300 | 0.000 | 0.001 | 0.229 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 198 | 198 | 369 | 463 | 592 | 592 | 0 | 534 | 570 | 0 |
| N.S. |
1 | 1.00 | 1.86 | 2.34 | 2.99 | 2.99 | 0.00 | 2.70 | 2.88 | 0.00 |
| time (sec) |
N/A | 0.106 | 0.079 | 0.171 | 0.314 | 0.299 | 0.000 | 0.001 | 0.399 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 200 | 200 | 371 | 464 | 603 | 603 | 0 | 534 | 581 | 0 |
| N.S. |
1 | 1.00 | 1.86 | 2.32 | 3.02 | 3.02 | 0.00 | 2.67 | 2.90 | 0.00 |
| time (sec) |
N/A | 0.098 | 0.077 | 0.161 | 0.290 | 0.299 | 0.000 | 0.001 | 1.238 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 200 | 200 | 371 | 464 | 614 | 614 | 0 | 534 | 592 | 0 |
| N.S. |
1 | 1.00 | 1.86 | 2.32 | 3.07 | 3.07 | 0.00 | 2.67 | 2.96 | 0.00 |
| time (sec) |
N/A | 0.097 | 0.076 | 0.137 | 0.289 | 0.300 | 0.000 | 0.001 | 2.196 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 275 | 275 | 1817 | 1891 | 1877 | 1877 | 2088 | 2282 | 1847 | 1796 |
| N.S. | 1 | 1.00 | 6.61 | 6.88 | 6.83 | 6.83 | 7.59 | 8.30 | 6.72 | 6.53 |
| time (sec) |
N/A | 1.010 | 0.175 | 0.138 | 0.297 | 0.313 | 0.171 | 0.002 | 0.984 | 15.989 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 279 | 279 | 1702 | 1741 | 1740 | 1740 | 1965 | 2150 | 1702 | 1650 |
| N.S. | 1 | 1.00 | 6.10 | 6.24 | 6.24 | 6.24 | 7.04 | 7.71 | 6.10 | 5.91 |
| time (sec) |
N/A | 0.861 | 0.118 | 0.136 | 0.290 | 0.310 | 0.161 | 0.001 | 1.026 | 15.620 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 279 | 279 | 1539 | 1591 | 1581 | 1581 | 1775 | 1943 | 1549 | 1499 |
| N.S. | 1 | 1.00 | 5.52 | 5.70 | 5.67 | 5.67 | 6.36 | 6.96 | 5.55 | 5.37 |
| time (sec) |
N/A | 0.756 | 0.097 | 0.134 | 0.281 | 0.306 | 0.163 | 0.001 | 0.689 | 13.771 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 250 | 250 | 1397 | 1441 | 1437 | 1437 | 1598 | 1744 | 1404 | 1358 |
| N.S. | 1 | 1.00 | 5.59 | 5.76 | 5.75 | 5.75 | 6.39 | 6.98 | 5.62 | 5.43 |
| time (sec) |
N/A | 0.700 | 0.103 | 0.144 | 0.284 | 0.296 | 0.138 | 0.001 | 0.788 | 12.475 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 225 | 225 | 1241 | 1291 | 1283 | 1283 | 1428 | 1558 | 1253 | 1212 |
| N.S. | 1 | 1.00 | 5.52 | 5.74 | 5.70 | 5.70 | 6.35 | 6.92 | 5.57 | 5.39 |
| time (sec) |
N/A | 0.608 | 0.090 | 0.154 | 0.285 | 0.292 | 0.127 | 0.002 | 0.707 | 11.470 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 200 | 200 | 1105 | 1141 | 1135 | 1135 | 1280 | 1396 | 1106 | 1070 |
| N.S. | 1 | 1.00 | 5.52 | 5.70 | 5.68 | 5.68 | 6.40 | 6.98 | 5.53 | 5.35 |
| time (sec) |
N/A | 0.528 | 0.079 | 0.133 | 0.292 | 0.299 | 0.119 | 0.001 | 0.613 | 10.351 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 170 | 170 | 939 | 991 | 977 | 977 | 1088 | 1186 | 953 | 920 |
| N.S. | 1 | 1.00 | 5.52 | 5.83 | 5.75 | 5.75 | 6.40 | 6.98 | 5.61 | 5.41 |
| time (sec) |
N/A | 0.458 | 0.070 | 0.131 | 0.280 | 0.296 | 0.110 | 0.000 | 0.532 | 9.107 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 146 | 146 | 811 | 841 | 835 | 835 | 940 | 1024 | 806 | 779 |
| N.S. | 1 | 1.00 | 5.55 | 5.76 | 5.72 | 5.72 | 6.44 | 7.01 | 5.52 | 5.34 |
| time (sec) |
N/A | 0.370 | 0.053 | 0.135 | 0.268 | 0.300 | 0.102 | 0.000 | 0.341 | 7.881 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 119 | 119 | 660 | 691 | 686 | 686 | 748 | 811 | 664 | 637 |
| N.S. | 1 | 1.00 | 5.55 | 5.81 | 5.76 | 5.76 | 6.29 | 6.82 | 5.58 | 5.35 |
| time (sec) |
N/A | 0.319 | 0.045 | 0.130 | 0.309 | 0.295 | 0.086 | 0.000 | 0.426 | 6.702 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 511 | 541 | 535 | 535 | 586 | 634 | 495 | 490 |
| N.S. | 1 | 1.00 | 5.55 | 5.88 | 5.82 | 5.82 | 6.37 | 6.89 | 5.38 | 5.33 |
| time (sec) |
N/A | 0.250 | 0.036 | 0.231 | 0.267 | 0.293 | 0.079 | 0.001 | 0.231 | 5.603 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 358 | 391 | 384 | 384 | 415 | 445 | 348 | 342 |
| N.S. | 1 | 1.00 | 5.51 | 6.02 | 5.91 | 5.91 | 6.38 | 6.85 | 5.35 | 5.26 |
| time (sec) |
N/A | 0.184 | 0.026 | 0.141 | 0.269 | 0.294 | 0.068 | 0.000 | 0.320 | 4.415 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 220 | 241 | 240 | 240 | 248 | 259 | 208 | 199 |
| N.S. | 1 | 1.00 | 5.79 | 6.34 | 6.32 | 6.32 | 6.53 | 6.82 | 5.47 | 5.24 |
| time (sec) |
N/A | 0.012 | 0.016 | 0.118 | 0.276 | 0.290 | 0.056 | 0.001 | 0.129 | 3.233 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 108 | 114 | 12 | 108 | 106 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 7.71 | 8.14 | 0.86 | 7.71 | 7.57 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.113 | 0.273 | 0.291 | 0.041 | 0.000 | 0.080 | 2.012 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 241 | 241 | 591 | 2929 | 866 | 868 | 799 | 1041 | 979 | 708 |
| N.S. | 1 | 1.00 | 2.45 | 12.15 | 3.59 | 3.60 | 3.32 | 4.32 | 4.06 | 2.94 |
| time (sec) |
N/A | 0.070 | 0.182 | 0.517 | 0.311 | 0.299 | 0.845 | 0.000 | 0.130 | 8.439 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 258 | 258 | 708 | 933 | 874 | 1124 | 816 | 998 | 3475 | 770 |
| N.S. | 1 | 1.00 | 2.74 | 3.62 | 3.39 | 4.36 | 3.16 | 3.87 | 13.47 | 2.98 |
| time (sec) |
N/A | 0.325 | 0.144 | 0.151 | 0.278 | 0.314 | 1.509 | 0.001 | 0.352 | 9.257 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 262 | 262 | 708 | 914 | 881 | 1233 | 843 | 976 | 3299 | 889 |
| N.S. | 1 | 1.00 | 2.70 | 3.49 | 3.36 | 4.71 | 3.22 | 3.73 | 12.59 | 3.39 |
| time (sec) |
N/A | 0.304 | 0.145 | 0.158 | 0.282 | 0.304 | 6.304 | 0.001 | 0.378 | 11.534 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F(-1) | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 258 | 258 | 427 | 896 | 891 | 1316 | 0 | 957 | 2219 | 985 |
| N.S. |
1 | 1.00 | 1.66 | 3.47 | 3.45 | 5.10 | 0.00 | 3.71 | 8.60 | 3.82 |
| time (sec) |
N/A | 0.303 | 0.114 | 0.168 | 0.298 | 0.306 | 0.000 | 0.001 | 0.385 | 28.968 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F(-1) | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 262 | 262 | 359 | 881 | 903 | 1365 | 0 | 945 | 1494 | 1060 |
| N.S. |
1 | 1.00 | 1.37 | 3.36 | 3.45 | 5.21 | 0.00 | 3.61 | 5.70 | 4.05 |
| time (sec) |
N/A | 0.293 | 0.122 | 0.153 | 0.293 | 0.298 | 0.000 | 0.001 | 0.381 | 196.771 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 260 | 260 | 305 | 870 | 912 | 1395 | 0 | 934 | 1141 | 0 |
| N.S. |
1 | 1.00 | 1.17 | 3.35 | 3.51 | 5.37 | 0.00 | 3.59 | 4.39 | 0.00 |
| time (sec) |
N/A | 0.289 | 0.130 | 0.147 | 0.325 | 0.305 | 0.000 | 0.001 | 0.396 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 262 | 262 | 265 | 862 | 925 | 1386 | 0 | 928 | 997 | 0 |
| N.S. |
1 | 1.00 | 1.01 | 3.29 | 3.53 | 5.29 | 0.00 | 3.54 | 3.81 | 0.00 |
| time (sec) |
N/A | 0.268 | 0.135 | 0.150 | 0.366 | 0.307 | 0.000 | 0.001 | 0.422 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 258 | 258 | 239 | 856 | 934 | 1362 | 0 | 924 | 950 | 0 |
| N.S. |
1 | 1.00 | 0.93 | 3.32 | 3.62 | 5.28 | 0.00 | 3.58 | 3.68 | 0.00 |
| time (sec) |
N/A | 0.251 | 0.155 | 0.142 | 0.352 | 0.307 | 0.000 | 0.002 | 0.428 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 258 | 258 | 712 | 854 | 945 | 1296 | 0 | 922 | 946 | 0 |
| N.S. |
1 | 1.00 | 2.76 | 3.31 | 3.66 | 5.02 | 0.00 | 3.57 | 3.67 | 0.00 |
| time (sec) |
N/A | 0.231 | 0.195 | 0.168 | 0.389 | 0.306 | 0.000 | 0.002 | 0.263 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 257 | 257 | 708 | 859 | 957 | 1216 | 0 | 924 | 955 | 0 |
| N.S. |
1 | 1.00 | 2.75 | 3.34 | 3.72 | 4.73 | 0.00 | 3.60 | 3.72 | 0.00 |
| time (sec) |
N/A | 0.214 | 0.254 | 0.171 | 0.358 | 0.301 | 0.000 | 0.002 | 0.502 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 271 | 271 | 591 | 865 | 975 | 1107 | 0 | 926 | 866 | 0 |
| N.S. |
1 | 1.00 | 2.18 | 3.19 | 3.60 | 4.08 | 0.00 | 3.42 | 3.20 | 0.00 |
| time (sec) |
N/A | 0.195 | 0.224 | 0.244 | 0.319 | 0.303 | 0.000 | 0.001 | 0.555 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 665 | 866 | 920 | 920 | 0 | 1019 | 1066 | 0 |
| N.S. |
1 | 1.00 | 23.75 | 30.93 | 32.86 | 32.86 | 0.00 | 36.39 | 38.07 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.171 | 0.137 | 0.336 | 0.309 | 0.000 | 0.001 | 0.458 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 684 | 867 | 986 | 986 | 0 | 1029 | 39 | 0 |
| N.S. |
1 | 1.00 | 11.79 | 14.95 | 17.00 | 17.00 | 0.00 | 17.74 | 0.67 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.168 | 0.141 | 0.320 | 0.301 | 0.000 | 0.002 | 0.394 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 89 | 89 | 690 | 867 | 997 | 997 | 0 | 1029 | 1098 | 0 |
| N.S. |
1 | 1.00 | 7.75 | 9.74 | 11.20 | 11.20 | 0.00 | 11.56 | 12.34 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.176 | 0.151 | 0.373 | 0.301 | 0.000 | 0.002 | 0.475 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 120 | 120 | 692 | 867 | 1008 | 1008 | 0 | 1029 | 1109 | 0 |
| N.S. |
1 | 1.00 | 5.77 | 7.22 | 8.40 | 8.40 | 0.00 | 8.58 | 9.24 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.173 | 0.148 | 0.328 | 0.297 | 0.000 | 0.001 | 1.295 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 151 | 151 | 690 | 867 | 1019 | 1019 | 0 | 1029 | 1120 | 0 |
| N.S. |
1 | 1.00 | 4.57 | 5.74 | 6.75 | 6.75 | 0.00 | 6.81 | 7.42 | 0.00 |
| time (sec) |
N/A | 0.033 | 0.177 | 0.145 | 0.328 | 0.298 | 0.000 | 0.002 | 2.279 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 182 | 182 | 694 | 867 | 1030 | 1030 | 0 | 1029 | 1131 | 0 |
| N.S. |
1 | 1.00 | 3.81 | 4.76 | 5.66 | 5.66 | 0.00 | 5.65 | 6.21 | 0.00 |
| time (sec) |
N/A | 0.046 | 0.173 | 0.209 | 0.341 | 0.312 | 0.000 | 0.002 | 0.584 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 213 | 213 | 690 | 867 | 1041 | 1041 | 0 | 1029 | 1142 | 0 |
| N.S. |
1 | 1.00 | 3.24 | 4.07 | 4.89 | 4.89 | 0.00 | 4.83 | 5.36 | 0.00 |
| time (sec) |
N/A | 0.059 | 0.177 | 0.142 | 0.325 | 0.303 | 0.000 | 0.002 | 0.658 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 244 | 244 | 694 | 867 | 1052 | 1052 | 0 | 1029 | 1153 | 0 |
| N.S. |
1 | 1.00 | 2.84 | 3.55 | 4.31 | 4.31 | 0.00 | 4.22 | 4.73 | 0.00 |
| time (sec) |
N/A | 0.074 | 0.174 | 0.163 | 0.335 | 0.306 | 0.000 | 0.002 | 12.020 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 273 | 273 | 692 | 866 | 1063 | 1063 | 0 | 1029 | 1164 | 0 |
| N.S. |
1 | 1.00 | 2.53 | 3.17 | 3.89 | 3.89 | 0.00 | 3.77 | 4.26 | 0.00 |
| time (sec) |
N/A | 0.203 | 0.172 | 0.148 | 0.327 | 0.303 | 0.000 | 0.002 | 25.721 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 279 | 279 | 692 | 867 | 1074 | 1074 | 0 | 1029 | 1175 | 0 |
| N.S. |
1 | 1.00 | 2.48 | 3.11 | 3.85 | 3.85 | 0.00 | 3.69 | 4.21 | 0.00 |
| time (sec) |
N/A | 0.179 | 0.181 | 0.160 | 0.338 | 0.305 | 0.000 | 0.002 | 0.799 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 279 | 279 | 692 | 867 | 1085 | 1085 | 0 | 1029 | 1186 | 0 |
| N.S. |
1 | 1.00 | 2.48 | 3.11 | 3.89 | 3.89 | 0.00 | 3.69 | 4.25 | 0.00 |
| time (sec) |
N/A | 0.183 | 0.184 | 0.181 | 0.335 | 0.307 | 0.000 | 0.002 | 1.036 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 122 | 122 | 167 | 266 | 258 | 259 | 209 | 296 | 280 | 191 |
| N.S. | 1 | 1.00 | 1.37 | 2.18 | 2.11 | 2.12 | 1.71 | 2.43 | 2.30 | 1.57 |
| time (sec) |
N/A | 0.039 | 0.046 | 0.141 | 0.270 | 0.293 | 0.302 | 0.000 | 0.074 | 3.698 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 98 | 98 | 115 | 189 | 177 | 179 | 136 | 198 | 189 | 127 |
| N.S. | 1 | 1.00 | 1.17 | 1.93 | 1.81 | 1.83 | 1.39 | 2.02 | 1.93 | 1.30 |
| time (sec) |
N/A | 0.027 | 0.029 | 0.151 | 0.260 | 0.295 | 0.234 | 0.000 | 0.218 | 3.021 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 74 | 109 | 114 | 115 | 83 | 124 | 118 | 79 |
| N.S. | 1 | 1.00 | 1.00 | 1.47 | 1.54 | 1.55 | 1.12 | 1.68 | 1.59 | 1.07 |
| time (sec) |
N/A | 0.021 | 0.021 | 0.137 | 0.273 | 0.290 | 0.181 | 0.000 | 0.065 | 2.485 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 50 | 50 | 43 | 56 | 60 | 62 | 44 | 65 | 62 | 46 |
| N.S. | 1 | 1.00 | 0.86 | 1.12 | 1.20 | 1.24 | 0.88 | 1.30 | 1.24 | 0.92 |
| time (sec) |
N/A | 0.015 | 0.012 | 0.177 | 0.273 | 0.288 | 0.128 | 0.000 | 0.225 | 2.088 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 26 | 26 | 25 | 26 | 26 | 25 | 20 | 26 | 25 | 24 |
| N.S. | 1 | 1.00 | 0.96 | 1.00 | 1.00 | 0.96 | 0.77 | 1.00 | 0.96 | 0.92 |
| time (sec) |
N/A | 0.013 | 0.006 | 0.123 | 0.263 | 0.295 | 0.085 | 0.001 | 0.201 | 1.857 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 10 | 10 | 10 | 11 | 10 | 10 | 7 | 10 | 10 | 10 |
| N.S. | 1 | 1.00 | 1.00 | 1.10 | 1.00 | 1.00 | 0.70 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.123 | 0.269 | 0.306 | 0.030 | 0.000 | 0.022 | 1.684 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 26 | 37 | 36 | 26 | 128 | 43 | 25 | 30 |
| N.S. | 1 | 1.00 | 0.72 | 1.03 | 1.00 | 0.72 | 3.56 | 1.19 | 0.69 | 0.83 |
| time (sec) |
N/A | 0.006 | 0.009 | 0.156 | 0.282 | 0.295 | 0.188 | 0.001 | 0.258 | 3.591 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 53 | 57 | 92 | 93 | 233 | 101 | 46 | 93 |
| N.S. | 1 | 1.00 | 0.93 | 1.00 | 1.61 | 1.63 | 4.09 | 1.77 | 0.81 | 1.63 |
| time (sec) |
N/A | 0.023 | 0.018 | 0.164 | 0.315 | 0.297 | 0.401 | 0.001 | 0.142 | 4.806 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 67 | 81 | 202 | 242 | 381 | 172 | 182 | 227 |
| N.S. | 1 | 1.00 | 0.82 | 0.99 | 2.46 | 2.95 | 4.65 | 2.10 | 2.22 | 2.77 |
| time (sec) |
N/A | 0.035 | 0.042 | 0.172 | 0.285 | 0.301 | 0.620 | 0.001 | 0.161 | 6.843 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 130 | 130 | 228 | 259 | 264 | 373 | 231 | 290 | 327 | 227 |
| N.S. | 1 | 1.00 | 1.75 | 1.99 | 2.03 | 2.87 | 1.78 | 2.23 | 2.52 | 1.75 |
| time (sec) |
N/A | 0.100 | 0.053 | 0.175 | 0.362 | 0.298 | 0.535 | 0.001 | 0.245 | 4.088 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 104 | 104 | 165 | 175 | 183 | 267 | 155 | 197 | 203 | 160 |
| N.S. | 1 | 1.00 | 1.59 | 1.68 | 1.76 | 2.57 | 1.49 | 1.89 | 1.95 | 1.54 |
| time (sec) |
N/A | 0.074 | 0.041 | 0.144 | 0.262 | 0.295 | 0.414 | 0.001 | 0.073 | 3.316 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 75 | 75 | 114 | 108 | 117 | 172 | 102 | 126 | 123 | 107 |
| N.S. | 1 | 1.00 | 1.52 | 1.44 | 1.56 | 2.29 | 1.36 | 1.68 | 1.64 | 1.43 |
| time (sec) |
N/A | 0.045 | 0.025 | 0.138 | 0.284 | 0.290 | 0.299 | 0.001 | 0.077 | 2.650 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 47 | 63 | 67 | 92 | 60 | 69 | 71 | 67 |
| N.S. | 1 | 1.00 | 0.92 | 1.24 | 1.31 | 1.80 | 1.18 | 1.35 | 1.39 | 1.31 |
| time (sec) |
N/A | 0.028 | 0.027 | 0.138 | 0.269 | 0.298 | 0.204 | 0.001 | 0.236 | 2.281 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 31 | 31 | 31 | 33 | 34 | 37 | 27 | 33 | 32 | 32 |
| N.S. | 1 | 1.00 | 1.00 | 1.06 | 1.10 | 1.19 | 0.87 | 1.06 | 1.03 | 1.03 |
| time (sec) |
N/A | 0.015 | 0.008 | 0.121 | 0.281 | 0.304 | 0.108 | 0.001 | 0.041 | 1.935 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 12 | 12 | 12 | 13 | 12 | 13 | 10 | 9 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 1.08 | 1.00 | 1.08 | 0.83 | 0.75 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.001 | 0.002 | 0.126 | 0.347 | 0.289 | 0.066 | 0.000 | 0.187 | 1.690 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 56 | 56 | 53 | 58 | 90 | 92 | 233 | 101 | 47 | 95 |
| N.S. | 1 | 1.00 | 0.95 | 1.04 | 1.61 | 1.64 | 4.16 | 1.80 | 0.84 | 1.70 |
| time (sec) |
N/A | 0.023 | 0.019 | 0.158 | 0.295 | 0.289 | 0.399 | 0.001 | 0.292 | 5.092 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 66 | 82 | 208 | 241 | 406 | 165 | 74 | 248 |
| N.S. | 1 | 1.00 | 0.81 | 1.01 | 2.57 | 2.98 | 5.01 | 2.04 | 0.91 | 3.06 |
| time (sec) |
N/A | 0.036 | 0.045 | 0.161 | 0.292 | 0.300 | 0.647 | 0.002 | 0.334 | 6.849 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 109 | 109 | 98 | 109 | 386 | 494 | 634 | 264 | 330 | 495 |
| N.S. | 1 | 1.00 | 0.90 | 1.00 | 3.54 | 4.53 | 5.82 | 2.42 | 3.03 | 4.54 |
| time (sec) |
N/A | 0.058 | 0.050 | 0.165 | 0.312 | 0.301 | 1.041 | 0.002 | 0.396 | 9.777 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 158 | 158 | 303 | 351 | 364 | 548 | 340 | 384 | 441 | 380 |
| N.S. | 1 | 1.00 | 1.92 | 2.22 | 2.30 | 3.47 | 2.15 | 2.43 | 2.79 | 2.41 |
| time (sec) |
N/A | 0.145 | 0.073 | 0.140 | 0.329 | 0.296 | 1.310 | 0.001 | 0.274 | 7.449 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 133 | 133 | 230 | 254 | 271 | 416 | 258 | 287 | 291 | 288 |
| N.S. | 1 | 1.00 | 1.73 | 1.91 | 2.04 | 3.13 | 1.94 | 2.16 | 2.19 | 2.17 |
| time (sec) |
N/A | 0.086 | 0.049 | 0.140 | 0.266 | 0.293 | 0.995 | 0.001 | 0.099 | 4.768 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 103 | 103 | 167 | 172 | 191 | 291 | 185 | 198 | 196 | 210 |
| N.S. | 1 | 1.00 | 1.62 | 1.67 | 1.85 | 2.83 | 1.80 | 1.92 | 1.90 | 2.04 |
| time (sec) |
N/A | 0.063 | 0.038 | 0.142 | 0.272 | 0.297 | 0.721 | 0.001 | 0.099 | 3.915 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 78 | 78 | 114 | 114 | 125 | 188 | 128 | 125 | 130 | 144 |
| N.S. | 1 | 1.00 | 1.46 | 1.46 | 1.60 | 2.41 | 1.64 | 1.60 | 1.67 | 1.85 |
| time (sec) |
N/A | 0.042 | 0.028 | 0.147 | 0.276 | 0.294 | 0.495 | 0.001 | 0.109 | 3.195 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 59 | 59 | 48 | 69 | 80 | 100 | 80 | 75 | 77 | 84 |
| N.S. | 1 | 1.00 | 0.81 | 1.17 | 1.36 | 1.69 | 1.36 | 1.27 | 1.31 | 1.42 |
| time (sec) |
N/A | 0.029 | 0.018 | 0.134 | 0.266 | 0.290 | 0.266 | 0.001 | 0.228 | 2.580 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 26 | 35 | 38 | 38 | 39 | 29 | 39 | 37 |
| N.S. | 1 | 1.00 | 0.93 | 1.25 | 1.36 | 1.36 | 1.39 | 1.04 | 1.39 | 1.32 |
| time (sec) |
N/A | 0.003 | 0.007 | 0.121 | 0.280 | 0.283 | 0.152 | 0.001 | 0.029 | 2.013 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 24 | 26 | 12 | 26 | 23 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 1.71 | 1.86 | 0.86 | 1.86 | 1.64 |
| time (sec) |
N/A | 0.001 | 0.002 | 0.121 | 0.257 | 0.298 | 0.093 | 0.000 | 0.024 | 1.817 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 67 | 81 | 202 | 242 | 381 | 171 | 183 | 227 |
| N.S. | 1 | 1.00 | 0.82 | 0.99 | 2.46 | 2.95 | 4.65 | 2.09 | 2.23 | 2.77 |
| time (sec) |
N/A | 0.035 | 0.042 | 0.168 | 0.276 | 0.299 | 0.609 | 0.001 | 0.299 | 6.626 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 110 | 110 | 97 | 108 | 386 | 495 | 632 | 264 | 329 | 496 |
| N.S. | 1 | 1.00 | 0.88 | 0.98 | 3.51 | 4.50 | 5.75 | 2.40 | 2.99 | 4.51 |
| time (sec) |
N/A | 0.051 | 0.074 | 0.174 | 0.272 | 0.300 | 0.992 | 0.002 | 0.395 | 9.910 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 143 | 143 | 128 | 140 | 594 | 760 | 881 | 357 | 542 | 783 |
| N.S. | 1 | 1.00 | 0.90 | 0.98 | 4.15 | 5.31 | 6.16 | 2.50 | 3.79 | 5.48 |
| time (sec) |
N/A | 0.073 | 0.079 | 0.178 | 0.274 | 0.305 | 1.465 | 0.002 | 0.526 | 13.602 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 232 | 232 | 584 | 705 | 786 | 1093 | 0 | 764 | 784 | 0 |
| N.S. |
1 | 1.00 | 2.52 | 3.04 | 3.39 | 4.71 | 0.00 | 3.29 | 3.38 | 0.00 |
| time (sec) |
N/A | 0.246 | 0.177 | 0.145 | 0.342 | 0.303 | 0.000 | 0.001 | 0.257 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 209 | 209 | 474 | 576 | 649 | 852 | 0 | 621 | 649 | 0 |
| N.S. |
1 | 1.00 | 2.27 | 2.76 | 3.11 | 4.08 | 0.00 | 2.97 | 3.11 | 0.00 |
| time (sec) |
N/A | 0.188 | 0.128 | 0.144 | 0.299 | 0.304 | 0.000 | 0.001 | 0.430 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 194 | 194 | 308 | 462 | 535 | 625 | 0 | 494 | 460 | 0 |
| N.S. |
1 | 1.00 | 1.59 | 2.38 | 2.76 | 3.22 | 0.00 | 2.55 | 2.37 | 0.00 |
| time (sec) |
N/A | 0.145 | 0.102 | 0.139 | 0.285 | 0.306 | 0.000 | 0.001 | 0.383 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 271 | 357 | 398 | 398 | 0 | 399 | 378 | 375 |
| N.S. |
1 | 1.00 | 9.68 | 12.75 | 14.21 | 14.21 | 0.00 | 14.25 | 13.50 | 13.39 |
| time (sec) |
N/A | 0.003 | 0.057 | 0.136 | 0.275 | 0.291 | 0.000 | 0.001 | 0.146 | 193.321 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F(-1) | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 58 | 58 | 205 | 265 | 326 | 326 | 0 | 294 | 39 | 307 |
| N.S. |
1 | 1.00 | 3.53 | 4.57 | 5.62 | 5.62 | 0.00 | 5.07 | 0.67 | 5.29 |
| time (sec) |
N/A | 0.008 | 0.037 | 0.156 | 0.294 | 0.293 | 0.000 | 0.001 | 0.277 | 39.215 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 89 | 89 | 144 | 186 | 247 | 247 | 267 | 201 | 237 | 232 |
| N.S. | 1 | 1.00 | 1.62 | 2.09 | 2.78 | 2.78 | 3.00 | 2.26 | 2.66 | 2.61 |
| time (sec) |
N/A | 0.014 | 0.032 | 0.141 | 0.269 | 0.304 | 108.564 | 0.001 | 0.110 | 9.403 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 94 | 122 | 182 | 182 | 196 | 126 | 176 | 173 |
| N.S. | 1 | 1.00 | 1.02 | 1.33 | 1.98 | 1.98 | 2.13 | 1.37 | 1.91 | 1.88 |
| time (sec) |
N/A | 0.043 | 0.020 | 0.139 | 0.267 | 0.298 | 2.014 | 0.001 | 0.099 | 4.829 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 55 | 71 | 131 | 131 | 139 | 69 | 129 | 125 |
| N.S. | 1 | 1.00 | 0.85 | 1.09 | 2.02 | 2.02 | 2.14 | 1.06 | 1.98 | 1.92 |
| time (sec) |
N/A | 0.028 | 0.017 | 0.141 | 0.282 | 0.295 | 0.816 | 0.001 | 0.086 | 3.571 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 27 | 35 | 94 | 94 | 100 | 30 | 96 | 92 |
| N.S. | 1 | 1.00 | 0.71 | 0.92 | 2.47 | 2.47 | 2.63 | 0.79 | 2.53 | 2.42 |
| time (sec) |
N/A | 0.016 | 0.007 | 0.125 | 0.274 | 0.292 | 0.423 | 0.001 | 0.226 | 2.835 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 79 | 85 | 12 | 81 | 78 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 5.64 | 6.07 | 0.86 | 5.79 | 5.57 |
| time (sec) |
N/A | 0.001 | 0.003 | 0.125 | 0.285 | 0.299 | 0.239 | 0.001 | 0.223 | 2.456 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 202 | 202 | 196 | 192 | 1418 | 1589 | 1776 | 725 | 1299 | 1882 |
| N.S. | 1 | 1.00 | 0.97 | 0.95 | 7.02 | 7.87 | 8.79 | 3.59 | 6.43 | 9.32 |
| time (sec) |
N/A | 0.120 | 0.061 | 0.198 | 0.357 | 0.331 | 7.988 | 0.012 | 0.873 | 27.841 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | B | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 231 | 231 | 213 | 223 | 1881 | 2264 | 2336 | 894 | 1738 | 2737 |
| N.S. | 1 | 1.00 | 0.92 | 0.97 | 8.14 | 9.80 | 10.11 | 3.87 | 7.52 | 11.85 |
| time (sec) |
N/A | 0.190 | 0.151 | 0.201 | 0.460 | 0.353 | 25.483 | 0.008 | 1.386 | 42.523 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | F(-1) | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 276 | 276 | 254 | 265 | 2399 | 3016 | 0 | 1064 | 2224 | 2095 |
| N.S. |
1 | 1.00 | 0.92 | 0.96 | 8.69 | 10.93 | 0.00 | 3.86 | 8.06 | 7.59 |
| time (sec) |
N/A | 0.250 | 0.125 | 0.240 | 0.513 | 0.375 | 0.000 | 0.009 | 1.911 | 65.952 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 156 | 156 | 217 | 121 | 259 | 338 | 314 | 1039 | 137 | 247 |
| N.S. | 1 | 1.00 | 1.39 | 0.78 | 1.66 | 2.17 | 2.01 | 6.66 | 0.88 | 1.58 |
| time (sec) |
N/A | 0.042 | 0.112 | 0.138 | 0.268 | 0.304 | 2.415 | 0.007 | 0.081 | 7.075 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 129 | 129 | 154 | 100 | 181 | 245 | 223 | 748 | 112 | 172 |
| N.S. | 1 | 1.00 | 1.19 | 0.78 | 1.40 | 1.90 | 1.73 | 5.80 | 0.87 | 1.33 |
| time (sec) |
N/A | 0.036 | 0.078 | 0.163 | 0.277 | 0.299 | 1.997 | 0.005 | 0.225 | 5.568 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 102 | 78 | 118 | 164 | 146 | 500 | 87 | 110 |
| N.S. | 1 | 1.00 | 1.02 | 0.78 | 1.18 | 1.64 | 1.46 | 5.00 | 0.87 | 1.10 |
| time (sec) |
N/A | 0.024 | 0.063 | 0.151 | 0.288 | 0.300 | 1.545 | 0.004 | 0.065 | 4.378 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 71 | 71 | 61 | 56 | 68 | 99 | 85 | 300 | 68 | 63 |
| N.S. | 1 | 1.00 | 0.86 | 0.79 | 0.96 | 1.39 | 1.20 | 4.23 | 0.96 | 0.89 |
| time (sec) |
N/A | 0.018 | 0.038 | 0.137 | 0.286 | 0.297 | 1.194 | 0.002 | 0.240 | 3.443 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 42 | 42 | 30 | 34 | 33 | 46 | 36 | 147 | 29 | 29 |
| N.S. | 1 | 1.00 | 0.71 | 0.81 | 0.79 | 1.10 | 0.86 | 3.50 | 0.69 | 0.69 |
| time (sec) |
N/A | 0.011 | 0.021 | 0.123 | 0.268 | 0.308 | 0.915 | 0.001 | 0.043 | 2.742 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 12 | 12 | 21 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 0.75 | 0.75 | 1.31 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.001 | 0.007 | 0.119 | 0.261 | 0.298 | 0.028 | 0.000 | 0.021 | 1.618 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 62 | 62 | 62 | 61 | 0 | 143 | 61 | 73 | 50 | 48 |
| N.S. |
1 | 1.00 | 1.00 | 0.98 | 0.00 | 2.31 | 0.98 | 1.18 | 0.81 | 0.77 |
| time (sec) |
N/A | 0.038 | 0.077 | 0.164 | 0.000 | 0.307 | 1.945 | 0.002 | 0.066 | 4.176 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 70 | 70 | 69 | 73 | 0 | 232 | 573 | 82 | 61 | 597 |
| N.S. |
1 | 1.00 | 0.99 | 1.04 | 0.00 | 3.31 | 8.19 | 1.17 | 0.87 | 8.53 |
| time (sec) |
N/A | 0.021 | 0.176 | 0.157 | 0.000 | 0.316 | 21.974 | 0.003 | 0.242 | 22.411 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 110 | 110 | 99 | 106 | 0 | 456 | 1658 | 149 | 135 | 1307 |
| N.S. |
1 | 1.00 | 0.90 | 0.96 | 0.00 | 4.15 | 15.07 | 1.35 | 1.23 | 11.88 |
| time (sec) |
N/A | 0.054 | 0.395 | 0.144 | 0.000 | 0.311 | 95.194 | 0.005 | 0.302 | 57.125 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 146 | 146 | 131 | 152 | 0 | 785 | 0 | 254 | 207 | 2591 |
| N.S. |
1 | 1.00 | 0.90 | 1.04 | 0.00 | 5.38 | 0.00 | 1.74 | 1.42 | 17.75 |
| time (sec) |
N/A | 0.067 | 0.615 | 0.148 | 0.000 | 0.321 | 0.000 | 0.007 | 0.374 | 132.513 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 182 | 182 | 170 | 217 | 0 | 1176 | 0 | 388 | 297 | 0 |
| N.S. |
1 | 1.00 | 0.93 | 1.19 | 0.00 | 6.46 | 0.00 | 2.13 | 1.63 | 0.00 |
| time (sec) |
N/A | 0.084 | 0.918 | 0.145 | 0.000 | 0.323 | 0.000 | 0.009 | 0.217 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 218 | 218 | 224 | 293 | 0 | 1673 | 0 | 551 | 401 | 0 |
| N.S. |
1 | 1.00 | 1.03 | 1.34 | 0.00 | 7.67 | 0.00 | 2.53 | 1.84 | 0.00 |
| time (sec) |
N/A | 0.104 | 1.290 | 0.161 | 0.000 | 0.338 | 0.000 | 0.012 | 0.490 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 158 | 158 | 217 | 122 | 259 | 418 | 763 | 1798 | 137 | 452 |
| N.S. | 1 | 1.00 | 1.37 | 0.77 | 1.64 | 2.65 | 4.83 | 11.38 | 0.87 | 2.86 |
| time (sec) |
N/A | 0.036 | 0.118 | 0.158 | 0.263 | 0.304 | 13.415 | 0.010 | 0.244 | 22.898 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 129 | 129 | 154 | 100 | 181 | 311 | 559 | 1320 | 112 | 331 |
| N.S. | 1 | 1.00 | 1.19 | 0.78 | 1.40 | 2.41 | 4.33 | 10.23 | 0.87 | 2.57 |
| time (sec) |
N/A | 0.029 | 0.084 | 0.155 | 0.300 | 0.299 | 10.069 | 0.008 | 0.242 | 17.458 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 102 | 78 | 118 | 216 | 386 | 911 | 87 | 227 |
| N.S. | 1 | 1.00 | 1.02 | 0.78 | 1.18 | 2.16 | 3.86 | 9.11 | 0.87 | 2.27 |
| time (sec) |
N/A | 0.022 | 0.064 | 0.169 | 0.272 | 0.299 | 7.304 | 0.006 | 0.249 | 12.953 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 71 | 71 | 61 | 56 | 68 | 137 | 240 | 571 | 68 | 142 |
| N.S. | 1 | 1.00 | 0.86 | 0.79 | 0.96 | 1.93 | 3.38 | 8.04 | 0.96 | 2.00 |
| time (sec) |
N/A | 0.016 | 0.043 | 0.145 | 0.289 | 0.307 | 4.858 | 0.004 | 0.059 | 8.949 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 42 | 42 | 30 | 34 | 33 | 69 | 146 | 300 | 29 | 78 |
| N.S. | 1 | 1.00 | 0.71 | 0.81 | 0.79 | 1.64 | 3.48 | 7.14 | 0.69 | 1.86 |
| time (sec) |
N/A | 0.011 | 0.024 | 0.130 | 0.263 | 0.304 | 0.166 | 0.002 | 0.215 | 2.328 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 28 | 12 | 113 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 1.75 | 0.75 | 7.06 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.001 | 0.007 | 0.135 | 0.278 | 0.301 | 0.029 | 0.001 | 0.017 | 1.626 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 86 | 86 | 77 | 99 | 0 | 188 | 82 | 133 | 93 | 86 |
| N.S. |
1 | 1.00 | 0.90 | 1.15 | 0.00 | 2.19 | 0.95 | 1.55 | 1.08 | 1.00 |
| time (sec) |
N/A | 0.032 | 0.142 | 0.172 | 0.000 | 0.308 | 6.885 | 0.004 | 0.075 | 8.938 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 85 | 85 | 83 | 100 | 0 | 210 | 923 | 131 | 109 | 935 |
| N.S. |
1 | 1.00 | 0.98 | 1.18 | 0.00 | 2.47 | 10.86 | 1.54 | 1.28 | 11.00 |
| time (sec) |
N/A | 0.027 | 0.228 | 0.220 | 0.000 | 0.307 | 67.898 | 0.007 | 0.105 | 77.123 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 90 | 97 | 0 | 383 | 0 | 137 | 135 | 2342 |
| N.S. |
1 | 1.00 | 0.90 | 0.97 | 0.00 | 3.83 | 0.00 | 1.37 | 1.35 | 23.42 |
| time (sec) |
N/A | 0.031 | 0.338 | 0.158 | 0.000 | 0.322 | 0.000 | 0.007 | 0.284 | 246.497 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 129 | 126 | 0 | 666 | 0 | 228 | 209 | 0 |
| N.S. |
1 | 1.00 | 0.95 | 0.93 | 0.00 | 4.90 | 0.00 | 1.68 | 1.54 | 0.00 |
| time (sec) |
N/A | 0.040 | 0.544 | 0.157 | 0.000 | 0.322 | 0.000 | 0.009 | 0.338 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 172 | 172 | 171 | 172 | 0 | 1043 | 0 | 360 | 296 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 1.00 | 0.00 | 6.06 | 0.00 | 2.09 | 1.72 | 0.00 |
| time (sec) |
N/A | 0.051 | 0.855 | 0.162 | 0.000 | 0.322 | 0.000 | 0.012 | 0.371 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 208 | 208 | 223 | 237 | 0 | 1492 | 0 | 523 | 398 | 0 |
| N.S. |
1 | 1.00 | 1.07 | 1.14 | 0.00 | 7.17 | 0.00 | 2.51 | 1.91 | 0.00 |
| time (sec) |
N/A | 0.066 | 1.574 | 0.158 | 0.000 | 0.320 | 0.000 | 0.015 | 0.473 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 158 | 158 | 217 | 122 | 259 | 497 | 1292 | 2696 | 137 | 544 |
| N.S. | 1 | 1.00 | 1.37 | 0.77 | 1.64 | 3.15 | 8.18 | 17.06 | 0.87 | 3.44 |
| time (sec) |
N/A | 0.036 | 0.123 | 0.150 | 0.285 | 0.297 | 21.930 | 0.017 | 0.267 | 38.502 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 129 | 129 | 154 | 100 | 181 | 377 | 960 | 2008 | 112 | 406 |
| N.S. | 1 | 1.00 | 1.19 | 0.78 | 1.40 | 2.92 | 7.44 | 15.57 | 0.87 | 3.15 |
| time (sec) |
N/A | 0.029 | 0.090 | 0.149 | 0.261 | 0.300 | 16.794 | 0.012 | 0.234 | 27.917 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 100 | 100 | 102 | 78 | 118 | 268 | 549 | 1412 | 87 | 276 |
| N.S. | 1 | 1.00 | 1.02 | 0.78 | 1.18 | 2.68 | 5.49 | 14.12 | 0.87 | 2.76 |
| time (sec) |
N/A | 0.023 | 0.072 | 0.145 | 0.281 | 0.291 | 0.454 | 0.009 | 0.076 | 4.598 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 71 | 71 | 61 | 56 | 68 | 174 | 355 | 911 | 68 | 183 |
| N.S. | 1 | 1.00 | 0.86 | 0.79 | 0.96 | 2.45 | 5.00 | 12.83 | 0.96 | 2.58 |
| time (sec) |
N/A | 0.017 | 0.047 | 0.146 | 0.259 | 0.293 | 0.375 | 0.006 | 0.067 | 3.640 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 42 | 42 | 30 | 34 | 33 | 93 | 194 | 500 | 29 | 102 |
| N.S. | 1 | 1.00 | 0.71 | 0.81 | 0.79 | 2.21 | 4.62 | 11.90 | 0.69 | 2.43 |
| time (sec) |
N/A | 0.010 | 0.027 | 0.133 | 0.277 | 0.298 | 0.298 | 0.005 | 0.045 | 2.907 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 39 | 12 | 199 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 2.44 | 0.75 | 12.44 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.001 | 0.008 | 0.135 | 0.264 | 0.288 | 0.031 | 0.002 | 0.021 | 1.747 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 112 | 112 | 108 | 161 | 0 | 290 | 121 | 221 | 130 | 140 |
| N.S. |
1 | 1.00 | 0.96 | 1.44 | 0.00 | 2.59 | 1.08 | 1.97 | 1.16 | 1.25 |
| time (sec) |
N/A | 0.040 | 0.113 | 0.174 | 0.000 | 0.314 | 12.447 | 0.005 | 0.083 | 15.908 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | B | A | B | B |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 110 | 110 | 116 | 152 | 0 | 330 | 1312 | 216 | 161 | 1358 |
| N.S. |
1 | 1.00 | 1.05 | 1.38 | 0.00 | 3.00 | 11.93 | 1.96 | 1.46 | 12.35 |
| time (sec) |
N/A | 0.037 | 0.290 | 0.188 | 0.000 | 0.309 | 120.019 | 0.006 | 0.124 | 134.052 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 119 | 119 | 119 | 138 | 0 | 344 | 0 | 213 | 199 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 1.16 | 0.00 | 2.89 | 0.00 | 1.79 | 1.67 | 0.00 |
| time (sec) |
N/A | 0.033 | 0.417 | 0.196 | 0.000 | 0.308 | 0.000 | 0.008 | 0.160 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 126 | 126 | 119 | 130 | 0 | 563 | 0 | 210 | 222 | 0 |
| N.S. |
1 | 1.00 | 0.94 | 1.03 | 0.00 | 4.47 | 0.00 | 1.67 | 1.76 | 0.00 |
| time (sec) |
N/A | 0.033 | 0.527 | 0.165 | 0.000 | 0.313 | 0.000 | 0.010 | 0.365 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 162 | 162 | 172 | 159 | 0 | 894 | 0 | 332 | 309 | 0 |
| N.S. |
1 | 1.00 | 1.06 | 0.98 | 0.00 | 5.52 | 0.00 | 2.05 | 1.91 | 0.00 |
| time (sec) |
N/A | 0.047 | 0.901 | 0.163 | 0.000 | 0.310 | 0.000 | 0.014 | 0.412 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 198 | 198 | 222 | 205 | 0 | 1337 | 0 | 494 | 411 | 0 |
| N.S. |
1 | 1.00 | 1.12 | 1.04 | 0.00 | 6.75 | 0.00 | 2.49 | 2.08 | 0.00 |
| time (sec) |
N/A | 0.062 | 1.207 | 0.164 | 0.000 | 0.323 | 0.000 | 0.017 | 0.503 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 35 | 30 | 29 | 33 | 105 | 36 | 29 | 87 |
| N.S. | 1 | 1.00 | 1.00 | 0.86 | 0.83 | 0.94 | 3.00 | 1.03 | 0.83 | 2.49 |
| time (sec) |
N/A | 0.007 | 0.041 | 0.168 | 0.351 | 0.296 | 0.749 | 0.001 | 0.062 | 2.830 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 56 | 56 | 43 | 40 | 43 | 46 | 168 | 56 | 45 | 165 |
| N.S. | 1 | 1.00 | 0.77 | 0.71 | 0.77 | 0.82 | 3.00 | 1.00 | 0.80 | 2.95 |
| time (sec) |
N/A | 0.009 | 0.051 | 0.198 | 0.368 | 0.305 | 1.616 | 0.002 | 0.041 | 3.943 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 154 | 154 | 216 | 121 | 283 | 261 | 728 | 448 | 137 | 395 |
| N.S. | 1 | 1.00 | 1.40 | 0.79 | 1.84 | 1.69 | 4.73 | 2.91 | 0.89 | 2.56 |
| time (sec) |
N/A | 0.034 | 0.103 | 0.148 | 0.269 | 0.294 | 36.744 | 0.003 | 0.069 | 45.966 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 127 | 127 | 153 | 99 | 204 | 182 | 532 | 314 | 112 | 291 |
| N.S. | 1 | 1.00 | 1.20 | 0.78 | 1.61 | 1.43 | 4.19 | 2.47 | 0.88 | 2.29 |
| time (sec) |
N/A | 0.027 | 0.079 | 0.145 | 0.267 | 0.291 | 25.947 | 0.003 | 0.241 | 32.612 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 96 | 96 | 101 | 76 | 137 | 115 | 366 | 202 | 87 | 204 |
| N.S. | 1 | 1.00 | 1.05 | 0.79 | 1.43 | 1.20 | 3.81 | 2.10 | 0.91 | 2.12 |
| time (sec) |
N/A | 0.022 | 0.054 | 0.147 | 0.275 | 0.297 | 16.892 | 0.002 | 0.264 | 21.994 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 69 | 69 | 60 | 55 | 82 | 64 | 231 | 116 | 68 | 134 |
| N.S. | 1 | 1.00 | 0.87 | 0.80 | 1.19 | 0.93 | 3.35 | 1.68 | 0.99 | 1.94 |
| time (sec) |
N/A | 0.015 | 0.035 | 0.145 | 0.283 | 0.293 | 9.655 | 0.001 | 0.067 | 13.226 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 40 | 40 | 29 | 38 | 39 | 25 | 121 | 51 | 28 | 75 |
| N.S. | 1 | 1.00 | 0.72 | 0.95 | 0.98 | 0.62 | 3.02 | 1.28 | 0.70 | 1.88 |
| time (sec) |
N/A | 0.009 | 0.024 | 0.131 | 0.265 | 0.289 | 2.114 | 0.001 | 0.048 | 4.624 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 12 | 10 | 13 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 0.86 | 0.71 | 0.93 | 0.86 | 0.86 |
| time (sec) |
N/A | 0.001 | 0.006 | 0.128 | 0.264 | 0.292 | 0.029 | 0.000 | 0.021 | 1.642 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 47 | 37 | 0 | 119 | 44 | 46 | 38 | 49 |
| N.S. |
1 | 1.00 | 1.00 | 0.79 | 0.00 | 2.53 | 0.94 | 0.98 | 0.81 | 1.04 |
| time (sec) |
N/A | 0.013 | 0.039 | 0.156 | 0.000 | 0.308 | 2.219 | 0.001 | 0.273 | 4.086 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 76 | 76 | 75 | 87 | 0 | 280 | 0 | 98 | 74 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 1.14 | 0.00 | 3.68 | 0.00 | 1.29 | 0.97 | 0.00 |
| time (sec) |
N/A | 0.020 | 0.172 | 0.160 | 0.000 | 0.311 | 0.000 | 0.002 | 0.094 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 114 | 114 | 96 | 138 | 0 | 549 | 0 | 178 | 142 | 0 |
| N.S. |
1 | 1.00 | 0.84 | 1.21 | 0.00 | 4.82 | 0.00 | 1.56 | 1.25 | 0.00 |
| time (sec) |
N/A | 0.027 | 0.259 | 0.164 | 0.000 | 0.309 | 0.000 | 0.003 | 0.332 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 147 | 147 | 128 | 187 | 0 | 884 | 0 | 280 | 218 | 0 |
| N.S. |
1 | 1.00 | 0.87 | 1.27 | 0.00 | 6.01 | 0.00 | 1.90 | 1.48 | 0.00 |
| time (sec) |
N/A | 0.036 | 0.317 | 0.161 | 0.000 | 0.309 | 0.000 | 0.004 | 0.395 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 180 | 180 | 166 | 236 | 0 | 1325 | 0 | 409 | 307 | 0 |
| N.S. |
1 | 1.00 | 0.92 | 1.31 | 0.00 | 7.36 | 0.00 | 2.27 | 1.71 | 0.00 |
| time (sec) |
N/A | 0.047 | 0.518 | 0.156 | 0.000 | 0.323 | 0.000 | 0.005 | 0.455 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 152 | 152 | 214 | 324 | 267 | 271 | 243 | 465 | 192 | 192 |
| N.S. | 1 | 1.00 | 1.41 | 2.13 | 1.76 | 1.78 | 1.60 | 3.06 | 1.26 | 1.26 |
| time (sec) |
N/A | 0.035 | 0.109 | 0.154 | 0.287 | 0.299 | 19.450 | 0.007 | 0.077 | 21.124 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 123 | 123 | 151 | 219 | 189 | 192 | 168 | 314 | 153 | 130 |
| N.S. | 1 | 1.00 | 1.23 | 1.78 | 1.54 | 1.56 | 1.37 | 2.55 | 1.24 | 1.06 |
| time (sec) |
N/A | 0.029 | 0.077 | 0.155 | 0.278 | 0.295 | 14.338 | 0.005 | 0.056 | 14.839 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 94 | 94 | 99 | 136 | 125 | 124 | 109 | 192 | 114 | 82 |
| N.S. | 1 | 1.00 | 1.05 | 1.45 | 1.33 | 1.32 | 1.16 | 2.04 | 1.21 | 0.87 |
| time (sec) |
N/A | 0.023 | 0.056 | 0.191 | 0.276 | 0.291 | 10.179 | 0.003 | 0.082 | 10.564 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 59 | 74 | 75 | 73 | 65 | 106 | 67 | 48 |
| N.S. | 1 | 1.00 | 0.88 | 1.10 | 1.12 | 1.09 | 0.97 | 1.58 | 1.00 | 0.72 |
| time (sec) |
N/A | 0.016 | 0.042 | 0.174 | 0.270 | 0.295 | 6.288 | 0.002 | 0.264 | 7.244 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 27 | 33 | 37 | 35 | 60 | 42 | 25 | 46 |
| N.S. | 1 | 1.00 | 0.71 | 0.87 | 0.97 | 0.92 | 1.58 | 1.11 | 0.66 | 1.21 |
| time (sec) |
N/A | 0.011 | 0.023 | 0.165 | 0.276 | 0.301 | 0.325 | 0.001 | 0.054 | 1.990 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 13 | 12 | 20 | 12 | 15 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.86 | 1.43 | 0.86 | 1.07 | 0.86 | 0.86 |
| time (sec) |
N/A | 0.001 | 0.009 | 0.137 | 0.299 | 0.299 | 0.032 | 0.001 | 0.024 | 1.593 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 69 | 69 | 69 | 68 | 0 | 214 | 60 | 83 | 57 | 82 |
| N.S. |
1 | 1.00 | 1.00 | 0.99 | 0.00 | 3.10 | 0.87 | 1.20 | 0.83 | 1.19 |
| time (sec) |
N/A | 0.021 | 0.094 | 0.187 | 0.000 | 0.301 | 5.295 | 0.002 | 0.270 | 6.269 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 99 | 99 | 90 | 100 | 0 | 423 | 0 | 169 | 123 | 0 |
| N.S. |
1 | 1.00 | 0.91 | 1.01 | 0.00 | 4.27 | 0.00 | 1.71 | 1.24 | 0.00 |
| time (sec) |
N/A | 0.028 | 0.285 | 0.187 | 0.000 | 0.315 | 0.000 | 0.003 | 0.186 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 140 | 140 | 126 | 122 | 0 | 782 | 0 | 267 | 205 | 0 |
| N.S. |
1 | 1.00 | 0.90 | 0.87 | 0.00 | 5.59 | 0.00 | 1.91 | 1.46 | 0.00 |
| time (sec) |
N/A | 0.035 | 0.501 | 0.198 | 0.000 | 0.324 | 0.000 | 0.005 | 0.444 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 173 | 173 | 170 | 156 | 0 | 1204 | 0 | 381 | 294 | 0 |
| N.S. |
1 | 1.00 | 0.98 | 0.90 | 0.00 | 6.96 | 0.00 | 2.20 | 1.70 | 0.00 |
| time (sec) |
N/A | 0.046 | 0.656 | 0.189 | 0.000 | 0.317 | 0.000 | 0.007 | 0.541 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 152 | 152 | 217 | 294 | 265 | 283 | 196 | 421 | 229 | 152 |
| N.S. | 1 | 1.00 | 1.43 | 1.93 | 1.74 | 1.86 | 1.29 | 2.77 | 1.51 | 1.00 |
| time (sec) |
N/A | 0.036 | 0.107 | 0.169 | 0.267 | 0.296 | 29.403 | 0.008 | 0.083 | 25.161 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 125 | 125 | 153 | 198 | 187 | 203 | 136 | 282 | 175 | 105 |
| N.S. | 1 | 1.00 | 1.22 | 1.58 | 1.50 | 1.62 | 1.09 | 2.26 | 1.40 | 0.84 |
| time (sec) |
N/A | 0.029 | 0.088 | 0.164 | 0.283 | 0.305 | 22.292 | 0.006 | 0.302 | 19.426 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 96 | 96 | 101 | 122 | 122 | 136 | 461 | 172 | 128 | 136 |
| N.S. | 1 | 1.00 | 1.05 | 1.27 | 1.27 | 1.42 | 4.80 | 1.79 | 1.33 | 1.42 |
| time (sec) |
N/A | 0.022 | 0.069 | 0.166 | 0.270 | 0.292 | 0.603 | 0.004 | 0.088 | 5.144 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 67 | 67 | 62 | 66 | 72 | 85 | 265 | 89 | 68 | 87 |
| N.S. | 1 | 1.00 | 0.93 | 0.99 | 1.07 | 1.27 | 3.96 | 1.33 | 1.01 | 1.30 |
| time (sec) |
N/A | 0.017 | 0.047 | 0.163 | 0.285 | 0.298 | 0.603 | 0.003 | 0.072 | 3.782 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 40 | 40 | 29 | 34 | 28 | 46 | 124 | 42 | 29 | 47 |
| N.S. | 1 | 1.00 | 0.72 | 0.85 | 0.70 | 1.15 | 3.10 | 1.05 | 0.72 | 1.18 |
| time (sec) |
N/A | 0.011 | 0.026 | 0.135 | 0.263 | 0.294 | 0.501 | 0.003 | 0.246 | 2.757 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 31 | 14 | 23 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 1.94 | 0.88 | 1.44 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.001 | 0.008 | 0.135 | 0.276 | 0.292 | 0.035 | 0.001 | 0.026 | 1.568 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 93 | 93 | 85 | 90 | 0 | 398 | 83 | 135 | 100 | 107 |
| N.S. |
1 | 1.00 | 0.91 | 0.97 | 0.00 | 4.28 | 0.89 | 1.45 | 1.08 | 1.15 |
| time (sec) |
N/A | 0.029 | 0.172 | 0.168 | 0.000 | 0.312 | 7.040 | 0.003 | 0.333 | 7.508 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 124 | 124 | 125 | 121 | 0 | 782 | 0 | 241 | 161 | 0 |
| N.S. |
1 | 1.00 | 1.01 | 0.98 | 0.00 | 6.31 | 0.00 | 1.94 | 1.30 | 0.00 |
| time (sec) |
N/A | 0.038 | 0.301 | 0.168 | 0.000 | 0.330 | 0.000 | 0.005 | 0.377 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 167 | 167 | 168 | 143 | 0 | 1226 | 0 | 344 | 243 | 0 |
| N.S. |
1 | 1.00 | 1.01 | 0.86 | 0.00 | 7.34 | 0.00 | 2.06 | 1.46 | 0.00 |
| time (sec) |
N/A | 0.046 | 0.601 | 0.168 | 0.000 | 0.320 | 0.000 | 0.007 | 0.285 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 200 | 200 | 220 | 177 | 0 | 1840 | 0 | 469 | 334 | 0 |
| N.S. |
1 | 1.00 | 1.10 | 0.88 | 0.00 | 9.20 | 0.00 | 2.34 | 1.67 | 0.00 |
| time (sec) |
N/A | 0.097 | 0.914 | 0.174 | 0.000 | 0.322 | 0.000 | 0.009 | 0.641 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 25 | 19 | 18 | 95 | 66 | 1080 | 17 | 81 |
| N.S. | 1 | 1.00 | 1.14 | 0.86 | 0.82 | 4.32 | 3.00 | 49.09 | 0.77 | 3.68 |
| time (sec) |
N/A | 0.004 | 0.017 | 0.155 | 0.285 | 0.301 | 0.717 | 0.007 | 0.050 | 2.281 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 25 | 19 | 18 | 75 | 66 | 820 | 17 | 81 |
| N.S. | 1 | 1.00 | 1.14 | 0.86 | 0.82 | 3.41 | 3.00 | 37.27 | 0.77 | 3.68 |
| time (sec) |
N/A | 0.004 | 0.012 | 0.174 | 0.265 | 0.287 | 0.661 | 0.005 | 0.034 | 2.132 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 25 | 19 | 374 | 67 | 88 | 608 | 17 | 119 |
| N.S. | 1 | 1.00 | 1.14 | 0.86 | 17.00 | 3.05 | 4.00 | 27.64 | 0.77 | 5.41 |
| time (sec) |
N/A | 0.003 | 0.009 | 0.158 | 0.270 | 0.302 | 0.683 | 0.004 | 0.028 | 2.640 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 25 | 19 | 18 | 56 | 88 | 426 | 17 | 119 |
| N.S. | 1 | 1.00 | 1.14 | 0.86 | 0.82 | 2.55 | 4.00 | 19.36 | 0.77 | 5.41 |
| time (sec) |
N/A | 0.004 | 0.014 | 0.160 | 0.273 | 0.296 | 0.599 | 0.003 | 0.028 | 2.671 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 25 | 19 | 18 | 45 | 88 | 273 | 17 | 119 |
| N.S. | 1 | 1.00 | 1.14 | 0.86 | 0.82 | 2.05 | 4.00 | 12.41 | 0.77 | 5.41 |
| time (sec) |
N/A | 0.003 | 0.009 | 0.151 | 0.264 | 0.293 | 0.692 | 0.002 | 0.028 | 2.648 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 25 | 19 | 18 | 34 | 80 | 155 | 17 | 47 |
| N.S. | 1 | 1.00 | 1.14 | 0.86 | 0.82 | 1.55 | 3.64 | 7.05 | 0.77 | 2.14 |
| time (sec) |
N/A | 0.003 | 0.009 | 0.178 | 0.265 | 0.290 | 0.891 | 0.003 | 0.028 | 2.490 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 26 | 19 | 18 | 23 | 53 | 67 | 17 | 38 |
| N.S. | 1 | 1.00 | 1.18 | 0.86 | 0.82 | 1.05 | 2.41 | 3.05 | 0.77 | 1.73 |
| time (sec) |
N/A | 0.003 | 0.008 | 0.155 | 0.270 | 0.297 | 1.198 | 0.002 | 0.029 | 2.598 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 24 | 19 | 18 | 18 | 29 | 20 | 17 | 33 |
| N.S. | 1 | 1.00 | 1.20 | 0.95 | 0.90 | 0.90 | 1.45 | 1.00 | 0.85 | 1.65 |
| time (sec) |
N/A | 0.003 | 0.005 | 0.168 | 0.277 | 0.295 | 1.802 | 0.002 | 0.030 | 2.906 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 24 | 19 | 18 | 29 | 41 | 22 | 17 | 40 |
| N.S. | 1 | 1.00 | 1.20 | 0.95 | 0.90 | 1.45 | 2.05 | 1.10 | 0.85 | 2.00 |
| time (sec) |
N/A | 0.003 | 0.006 | 0.167 | 0.292 | 0.291 | 3.004 | 0.003 | 0.030 | 3.638 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 22 | 21 | 21 | 26 | 31 | 10 | 29 |
| N.S. | 1 | 1.00 | 1.00 | 1.57 | 1.50 | 1.50 | 1.86 | 2.21 | 0.71 | 2.07 |
| time (sec) |
N/A | 0.003 | 0.012 | 0.164 | 0.285 | 0.292 | 0.355 | 0.001 | 0.054 | 1.909 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 25 | 25 | 25 | 19 | 18 | 18 | 61 | 27 | 15 | 49 |
| N.S. | 1 | 1.00 | 1.00 | 0.76 | 0.72 | 0.72 | 2.44 | 1.08 | 0.60 | 1.96 |
| time (sec) |
N/A | 0.007 | 0.025 | 0.156 | 0.376 | 0.305 | 0.567 | 0.001 | 0.060 | 2.238 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 112 | 84 | 86 | 86 | 170 | 127 | 104 | 78 |
| N.S. | 1 | 1.00 | 1.33 | 1.00 | 1.02 | 1.02 | 2.02 | 1.51 | 1.24 | 0.93 |
| time (sec) |
N/A | 0.034 | 0.099 | 3.086 | 0.352 | 0.302 | 1.436 | 0.004 | 0.068 | 3.552 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 27 | 27 | 18 | 20 | 19 | 19 | 112 | 114 | 14 | 67 |
| N.S. | 1 | 1.00 | 0.67 | 0.74 | 0.70 | 0.70 | 4.15 | 4.22 | 0.52 | 2.48 |
| time (sec) |
N/A | 0.004 | 0.013 | 0.151 | 0.277 | 0.287 | 0.709 | 0.002 | 0.255 | 2.368 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 38 | 38 | 23 | 29 | 28 | 24 | 144 | 148 | 21 | 84 |
| N.S. | 1 | 1.00 | 0.61 | 0.76 | 0.74 | 0.63 | 3.79 | 3.89 | 0.55 | 2.21 |
| time (sec) |
N/A | 0.006 | 0.015 | 0.173 | 0.263 | 0.288 | 0.972 | 0.001 | 0.046 | 2.584 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 139 | 139 | 154 | 161 | 0 | 570 | 0 | 280 | 204 | 0 |
| N.S. |
1 | 1.00 | 1.11 | 1.16 | 0.00 | 4.10 | 0.00 | 2.01 | 1.47 | 0.00 |
| time (sec) |
N/A | 0.086 | 0.186 | 0.173 | 0.000 | 0.319 | 0.000 | 0.009 | 0.211 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 140 | 140 | 154 | 160 | 0 | 900 | 0 | 256 | 206 | 0 |
| N.S. |
1 | 1.00 | 1.10 | 1.14 | 0.00 | 6.43 | 0.00 | 1.83 | 1.47 | 0.00 |
| time (sec) |
N/A | 0.056 | 0.152 | 0.166 | 0.000 | 0.319 | 0.000 | 0.007 | 0.369 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F(-1) | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 230 | 230 | 166 | 239 | 0 | 702 | 0 | 1471 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 1.04 | 0.00 | 3.05 | 0.00 | 6.40 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.115 | 0.407 | 0.165 | 0.000 | 0.336 | 0.000 | 0.104 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F(-1) | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 192 | 192 | 144 | 206 | 0 | 540 | 0 | 972 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.75 | 1.07 | 0.00 | 2.81 | 0.00 | 5.06 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.073 | 0.338 | 0.185 | 0.000 | 0.325 | 0.000 | 0.070 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F(-1) | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 154 | 154 | 128 | 173 | 0 | 410 | 0 | 586 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.83 | 1.12 | 0.00 | 2.66 | 0.00 | 3.81 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.053 | 0.242 | 0.153 | 0.000 | 0.316 | 0.000 | 0.043 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | B | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 116 | 116 | 95 | 140 | 0 | 300 | 0 | 299 | 88 | 0 |
| N.S. |
1 | 1.00 | 0.82 | 1.21 | 0.00 | 2.59 | 0.00 | 2.58 | 0.76 | 0.00 |
| time (sec) |
N/A | 0.041 | 0.215 | 0.155 | 0.000 | 0.318 | 0.000 | 0.021 | 0.136 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 74 | 107 | 0 | 236 | 0 | 117 | 260 | 0 |
| N.S. |
1 | 1.00 | 1.03 | 1.49 | 0.00 | 3.28 | 0.00 | 1.62 | 3.61 | 0.00 |
| time (sec) |
N/A | 0.027 | 0.200 | 0.163 | 0.000 | 0.315 | 0.000 | 0.010 | 4.005 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F(-2) | B | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 66 | 0 | 0 | 241 | 0 | 127 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 3.65 | 0.00 | 1.92 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.024 | 0.081 | 0.059 | 0.000 | 0.341 | 0.000 | 0.025 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 32 | 88 | 0 | 65 | 0 | 96 | 27 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 2.75 | 0.00 | 2.03 | 0.00 | 3.00 | 0.84 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.031 | 0.156 | 0.000 | 0.341 | 0.000 | 0.039 | 0.717 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 128 | 0 | 175 | 0 | 195 | 127 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.94 | 0.00 | 2.65 | 0.00 | 2.95 | 1.92 | 0.00 |
| time (sec) |
N/A | 0.006 | 0.080 | 0.156 | 0.000 | 0.453 | 0.000 | 0.063 | 0.822 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 77 | 168 | 0 | 337 | 0 | 339 | 203 | 0 |
| N.S. |
1 | 1.00 | 0.76 | 1.66 | 0.00 | 3.34 | 0.00 | 3.36 | 2.01 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.090 | 0.157 | 0.000 | 0.779 | 0.000 | 0.106 | 0.966 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 93 | 208 | 0 | 532 | 0 | 527 | 292 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 1.53 | 0.00 | 3.91 | 0.00 | 3.88 | 2.15 | 0.00 |
| time (sec) |
N/A | 0.020 | 0.133 | 0.158 | 0.000 | 2.429 | 0.000 | 0.149 | 1.184 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 171 | 171 | 117 | 248 | 0 | 781 | 0 | 767 | 397 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 1.45 | 0.00 | 4.57 | 0.00 | 4.49 | 2.32 | 0.00 |
| time (sec) |
N/A | 0.030 | 0.142 | 0.156 | 0.000 | 5.205 | 0.000 | 0.197 | 1.432 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 227 | 227 | 166 | 239 | 0 | 702 | 0 | 2330 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.73 | 1.05 | 0.00 | 3.09 | 0.00 | 10.26 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.084 | 0.499 | 0.157 | 0.000 | 0.334 | 0.000 | 0.164 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 189 | 189 | 144 | 206 | 0 | 534 | 0 | 1443 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.76 | 1.09 | 0.00 | 2.83 | 0.00 | 7.63 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.065 | 0.378 | 0.160 | 0.000 | 0.326 | 0.000 | 0.108 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F(-1) | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 151 | 151 | 127 | 173 | 0 | 410 | 0 | 768 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.84 | 1.15 | 0.00 | 2.72 | 0.00 | 5.09 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.047 | 0.236 | 0.158 | 0.000 | 0.332 | 0.000 | 0.058 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F(-1) | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 113 | 113 | 94 | 140 | 0 | 306 | 0 | 186 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.83 | 1.24 | 0.00 | 2.71 | 0.00 | 1.65 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.035 | 0.166 | 0.156 | 0.000 | 0.315 | 0.000 | 0.015 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F(-2) | A | F | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 98 | 98 | 89 | 0 | 0 | 311 | 0 | 198 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.91 | 0.00 | 0.00 | 3.17 | 0.00 | 2.02 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.032 | 0.412 | 0.077 | 0.000 | 0.349 | 0.000 | 0.031 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F(-2) | B | F | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 81 | 0 | 0 | 325 | 0 | 237 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.88 | 0.00 | 0.00 | 3.53 | 0.00 | 2.58 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.028 | 0.140 | 0.066 | 0.000 | 0.387 | 0.000 | 0.049 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 32 | 161 | 0 | 104 | 0 | 149 | 27 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 5.03 | 0.00 | 3.25 | 0.00 | 4.66 | 0.84 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.044 | 0.180 | 0.000 | 0.470 | 0.000 | 0.075 | 0.796 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 201 | 0 | 235 | 0 | 276 | 178 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 3.05 | 0.00 | 3.56 | 0.00 | 4.18 | 2.70 | 0.00 |
| time (sec) |
N/A | 0.006 | 0.093 | 0.165 | 0.000 | 0.818 | 0.000 | 0.117 | 0.926 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 73 | 241 | 0 | 426 | 0 | 448 | 268 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 2.39 | 0.00 | 4.22 | 0.00 | 4.44 | 2.65 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.121 | 0.166 | 0.000 | 2.593 | 0.000 | 0.182 | 1.113 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 95 | 281 | 0 | 649 | 0 | 671 | 376 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 2.07 | 0.00 | 4.77 | 0.00 | 4.93 | 2.76 | 0.00 |
| time (sec) |
N/A | 0.020 | 0.147 | 0.166 | 0.000 | 5.500 | 0.000 | 0.249 | 1.333 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 262 | 262 | 191 | 272 | 0 | 882 | 0 | 4138 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.73 | 1.04 | 0.00 | 3.37 | 0.00 | 15.79 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.109 | 0.609 | 0.165 | 0.000 | 0.345 | 0.000 | 0.304 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 224 | 224 | 169 | 239 | 0 | 702 | 0 | 2623 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.75 | 1.07 | 0.00 | 3.13 | 0.00 | 11.71 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.086 | 0.480 | 0.167 | 0.000 | 0.332 | 0.000 | 0.192 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F(-1) | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 186 | 186 | 144 | 206 | 0 | 540 | 0 | 1443 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.77 | 1.11 | 0.00 | 2.90 | 0.00 | 7.76 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.061 | 0.331 | 0.164 | 0.000 | 0.323 | 0.000 | 0.107 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F(-1) | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 148 | 148 | 124 | 173 | 0 | 412 | 0 | 263 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.84 | 1.17 | 0.00 | 2.78 | 0.00 | 1.78 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.047 | 0.222 | 0.165 | 0.000 | 0.338 | 0.000 | 0.019 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F(-2) | A | F | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 138 | 138 | 124 | 0 | 0 | 439 | 0 | 282 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.90 | 0.00 | 0.00 | 3.18 | 0.00 | 2.04 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.046 | 0.250 | 0.057 | 0.000 | 0.383 | 0.000 | 0.043 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F(-2) | B | F | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 128 | 128 | 121 | 0 | 0 | 475 | 0 | 352 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.95 | 0.00 | 0.00 | 3.71 | 0.00 | 2.75 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.044 | 0.693 | 0.056 | 0.000 | 0.425 | 0.000 | 0.069 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F(-2) | B | F(-1) | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 120 | 120 | 111 | 0 | 0 | 463 | 0 | 421 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.92 | 0.00 | 0.00 | 3.86 | 0.00 | 3.51 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.037 | 0.130 | 0.057 | 0.000 | 0.588 | 0.000 | 0.103 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 32 | 234 | 0 | 138 | 0 | 199 | 27 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 7.31 | 0.00 | 4.31 | 0.00 | 6.22 | 0.84 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.046 | 0.158 | 0.000 | 0.797 | 0.000 | 0.155 | 0.971 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 274 | 0 | 295 | 0 | 355 | 229 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 4.15 | 0.00 | 4.47 | 0.00 | 5.38 | 3.47 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.098 | 0.158 | 0.000 | 2.699 | 0.000 | 0.242 | 1.140 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 73 | 314 | 0 | 513 | 0 | 561 | 333 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 3.11 | 0.00 | 5.08 | 0.00 | 5.55 | 3.30 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.123 | 0.159 | 0.000 | 6.026 | 0.000 | 0.308 | 1.355 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F(-2) | B | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 95 | 354 | 0 | 765 | 0 | 811 | 459 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 2.60 | 0.00 | 5.62 | 0.00 | 5.96 | 3.38 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.150 | 0.166 | 0.000 | 12.236 | 0.000 | 0.485 | 1.615 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F(-1) | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 183 | 183 | 164 | 206 | 0 | 542 | 0 | 353 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.90 | 1.13 | 0.00 | 2.96 | 0.00 | 1.93 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.069 | 0.191 | 0.158 | 0.000 | 0.332 | 0.000 | 0.024 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F(-1) | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 148 | 148 | 125 | 173 | 0 | 412 | 0 | 263 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.84 | 1.17 | 0.00 | 2.78 | 0.00 | 1.78 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.050 | 0.190 | 0.155 | 0.000 | 0.327 | 0.000 | 0.019 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 113 | 113 | 94 | 140 | 0 | 306 | 0 | 186 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.83 | 1.24 | 0.00 | 2.71 | 0.00 | 1.65 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.037 | 0.174 | 0.152 | 0.000 | 0.314 | 0.000 | 0.014 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 73 | 73 | 74 | 107 | 0 | 235 | 0 | 117 | 261 | 0 |
| N.S. |
1 | 1.00 | 1.01 | 1.47 | 0.00 | 3.22 | 0.00 | 1.60 | 3.58 | 0.00 |
| time (sec) |
N/A | 0.024 | 0.193 | 0.156 | 0.000 | 0.314 | 0.000 | 0.010 | 3.803 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 42 | 42 | 42 | 76 | 0 | 178 | 0 | 63 | 45 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 1.81 | 0.00 | 4.24 | 0.00 | 1.50 | 1.07 | 0.00 |
| time (sec) |
N/A | 0.018 | 0.061 | 0.157 | 0.000 | 0.309 | 0.000 | 0.006 | 0.288 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | B | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 27 | 0 | 42 | 0 | 71 | 26 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.90 | 0.00 | 1.40 | 0.00 | 2.37 | 0.87 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.027 | 0.161 | 0.000 | 0.303 | 0.000 | 0.007 | 0.732 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 55 | 0 | 118 | 0 | 136 | 71 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.83 | 0.00 | 1.79 | 0.00 | 2.06 | 1.08 | 0.00 |
| time (sec) |
N/A | 0.006 | 0.071 | 0.164 | 0.000 | 0.335 | 0.000 | 0.014 | 0.894 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 75 | 95 | 0 | 251 | 0 | 254 | 133 | 0 |
| N.S. |
1 | 1.00 | 0.74 | 0.94 | 0.00 | 2.49 | 0.00 | 2.51 | 1.32 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.083 | 0.162 | 0.000 | 0.462 | 0.000 | 0.027 | 1.005 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 93 | 135 | 0 | 419 | 0 | 429 | 209 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 0.99 | 0.00 | 3.08 | 0.00 | 3.15 | 1.54 | 0.00 |
| time (sec) |
N/A | 0.020 | 0.116 | 0.197 | 0.000 | 0.729 | 0.000 | 0.046 | 1.192 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 171 | 171 | 115 | 175 | 0 | 638 | 0 | 663 | 303 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 1.02 | 0.00 | 3.73 | 0.00 | 3.88 | 1.77 | 0.00 |
| time (sec) |
N/A | 0.029 | 0.131 | 0.155 | 0.000 | 2.274 | 0.000 | 0.076 | 1.370 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F(-2) | B | F | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 174 | 174 | 166 | 0 | 0 | 603 | 0 | 379 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.95 | 0.00 | 0.00 | 3.47 | 0.00 | 2.18 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.062 | 0.290 | 0.057 | 0.000 | 0.450 | 0.000 | 0.053 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F(-2) | A | F | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 138 | 138 | 124 | 0 | 0 | 441 | 0 | 282 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.90 | 0.00 | 0.00 | 3.20 | 0.00 | 2.04 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.047 | 0.229 | 0.058 | 0.000 | 0.378 | 0.000 | 0.042 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F(-2) | A | F | A | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 98 | 98 | 87 | 0 | 0 | 311 | 0 | 199 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.89 | 0.00 | 0.00 | 3.17 | 0.00 | 2.03 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.032 | 0.380 | 0.062 | 0.000 | 0.346 | 0.000 | 0.030 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F(-2) | B | F | A | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 66 | 0 | 0 | 241 | 0 | 127 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 3.65 | 0.00 | 1.92 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.023 | 0.080 | 0.056 | 0.000 | 0.332 | 0.000 | 0.023 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | A | F | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 27 | 0 | 42 | 0 | 72 | 26 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.90 | 0.00 | 1.40 | 0.00 | 2.40 | 0.87 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.026 | 0.160 | 0.000 | 0.307 | 0.000 | 0.009 | 0.741 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 62 | 62 | 42 | 65 | 0 | 125 | 0 | 177 | 71 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 1.05 | 0.00 | 2.02 | 0.00 | 2.85 | 1.15 | 0.00 |
| time (sec) |
N/A | 0.006 | 0.084 | 0.162 | 0.000 | 0.338 | 0.000 | 0.021 | 0.858 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 71 | 105 | 0 | 273 | 0 | 433 | 141 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.04 | 0.00 | 2.70 | 0.00 | 4.29 | 1.40 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.103 | 0.162 | 0.000 | 0.414 | 0.000 | 0.070 | 1.064 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 93 | 145 | 0 | 455 | 0 | 955 | 227 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 1.07 | 0.00 | 3.35 | 0.00 | 7.02 | 1.67 | 0.00 |
| time (sec) |
N/A | 0.020 | 0.115 | 0.160 | 0.000 | 0.601 | 0.000 | 0.178 | 1.312 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 171 | 171 | 117 | 185 | 0 | 689 | 0 | 1731 | 337 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 1.08 | 0.00 | 4.03 | 0.00 | 10.12 | 1.97 | 0.00 |
| time (sec) |
N/A | 0.030 | 0.137 | 0.158 | 0.000 | 1.499 | 0.000 | 0.394 | 1.500 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F(-1) | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 206 | 206 | 139 | 225 | 0 | 955 | 0 | 2771 | 454 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 1.09 | 0.00 | 4.64 | 0.00 | 13.45 | 2.20 | 0.00 |
| time (sec) |
N/A | 0.042 | 0.134 | 0.161 | 0.000 | 3.591 | 0.000 | 0.769 | 1.959 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F(-2) | B | F(-1) | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 204 | 204 | 165 | 0 | 0 | 879 | 0 | 613 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.81 | 0.00 | 0.00 | 4.31 | 0.00 | 3.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.074 | 0.372 | 0.057 | 0.000 | 0.818 | 0.000 | 0.105 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F(-2) | B | F(-1) | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 170 | 170 | 166 | 0 | 0 | 657 | 0 | 475 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.98 | 0.00 | 0.00 | 3.86 | 0.00 | 2.79 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.056 | 0.254 | 0.055 | 0.000 | 0.573 | 0.000 | 0.085 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F(-2) | B | F | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 128 | 128 | 123 | 0 | 0 | 475 | 0 | 353 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.96 | 0.00 | 0.00 | 3.71 | 0.00 | 2.76 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.041 | 0.652 | 0.054 | 0.000 | 0.449 | 0.000 | 0.067 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F(-2) | B | F | B | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 92 | 92 | 81 | 0 | 0 | 325 | 0 | 238 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.88 | 0.00 | 0.00 | 3.53 | 0.00 | 2.59 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.028 | 0.140 | 0.056 | 0.000 | 0.404 | 0.000 | 0.049 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F | A | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 32 | 88 | 0 | 65 | 0 | 97 | 130 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 2.75 | 0.00 | 2.03 | 0.00 | 3.03 | 4.06 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.032 | 0.155 | 0.000 | 0.343 | 0.000 | 0.037 | 0.561 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 55 | 0 | 118 | 0 | 174 | 127 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.83 | 0.00 | 1.79 | 0.00 | 2.64 | 1.92 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.071 | 0.158 | 0.000 | 0.366 | 0.000 | 0.015 | 0.897 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 98 | 98 | 73 | 95 | 0 | 273 | 0 | 459 | 132 | 0 |
| N.S. |
1 | 1.00 | 0.74 | 0.97 | 0.00 | 2.79 | 0.00 | 4.68 | 1.35 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.106 | 0.162 | 0.000 | 0.512 | 0.000 | 0.039 | 1.030 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 135 | 135 | 92 | 135 | 0 | 447 | 0 | 799 | 224 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 1.00 | 0.00 | 3.31 | 0.00 | 5.92 | 1.66 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.126 | 0.155 | 0.000 | 0.663 | 0.000 | 0.126 | 1.289 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 172 | 172 | 117 | 175 | 0 | 715 | 0 | 1406 | 346 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 1.02 | 0.00 | 4.16 | 0.00 | 8.17 | 2.01 | 0.00 |
| time (sec) |
N/A | 0.031 | 0.138 | 0.160 | 0.000 | 1.954 | 0.000 | 0.337 | 1.531 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F(-2) | B | F | B | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 207 | 207 | 139 | 215 | 0 | 999 | 0 | 2268 | 478 | 0 |
| N.S. |
1 | 1.00 | 0.67 | 1.04 | 0.00 | 4.83 | 0.00 | 10.96 | 2.31 | 0.00 |
| time (sec) |
N/A | 0.043 | 0.129 | 0.178 | 0.000 | 4.344 | 0.000 | 0.735 | 1.908 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 26 | 86 | 48 | 31 | 0 | 27 | 50 | 0 |
| N.S. |
1 | 1.00 | 1.37 | 4.53 | 2.53 | 1.63 | 0.00 | 1.42 | 2.63 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.036 | 0.170 | 0.269 | 0.293 | 0.000 | 0.002 | 0.308 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 25 | 66 | 33 | 27 | 0 | 26 | 47 | 0 |
| N.S. |
1 | 1.00 | 1.32 | 3.47 | 1.74 | 1.42 | 0.00 | 1.37 | 2.47 | 0.00 |
| time (sec) |
N/A | 0.004 | 0.035 | 0.169 | 0.263 | 0.294 | 0.000 | 0.002 | 0.339 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 25 | 66 | 33 | 27 | 0 | 26 | 43 | 0 |
| N.S. |
1 | 1.00 | 1.32 | 3.47 | 1.74 | 1.42 | 0.00 | 1.37 | 2.26 | 0.00 |
| time (sec) |
N/A | 0.004 | 0.035 | 0.158 | 0.260 | 0.296 | 0.000 | 0.002 | 0.326 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 42 | 60 | 32 | 25 | 15 | 24 | 33 | 14 |
| N.S. | 1 | 1.00 | 2.47 | 3.53 | 1.88 | 1.47 | 0.88 | 1.41 | 1.94 | 0.82 |
| time (sec) |
N/A | 0.003 | 0.034 | 0.142 | 0.273 | 0.295 | 0.680 | 0.002 | 0.309 | 2.378 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 25 | 64 | 33 | 27 | 0 | 26 | 44 | 0 |
| N.S. |
1 | 1.00 | 1.32 | 3.37 | 1.74 | 1.42 | 0.00 | 1.37 | 2.32 | 0.00 |
| time (sec) |
N/A | 0.004 | 0.035 | 0.157 | 0.270 | 0.293 | 0.000 | 0.002 | 0.318 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 11 | 11 | 25 | 57 | 26 | 26 | 75 | 26 | 50 | 69 |
| N.S. | 1 | 1.00 | 2.27 | 5.18 | 2.36 | 2.36 | 6.82 | 2.36 | 4.55 | 6.27 |
| time (sec) |
N/A | 0.002 | 0.036 | 0.159 | 0.260 | 0.304 | 18.009 | 0.002 | 0.304 | 15.212 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 25 | 66 | 33 | 27 | 0 | 26 | 46 | 0 |
| N.S. |
1 | 1.00 | 1.32 | 3.47 | 1.74 | 1.42 | 0.00 | 1.37 | 2.42 | 0.00 |
| time (sec) |
N/A | 0.004 | 0.034 | 0.161 | 0.262 | 0.292 | 0.000 | 0.002 | 0.292 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 25 | 66 | 33 | 28 | 0 | 26 | 47 | 0 |
| N.S. |
1 | 1.00 | 1.67 | 4.40 | 2.20 | 1.87 | 0.00 | 1.73 | 3.13 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.035 | 0.158 | 0.272 | 0.296 | 0.000 | 0.001 | 0.293 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 10 | 10 | 10 | 11 | 10 | 10 | 7 | 10 | 10 | 10 |
| N.S. | 1 | 1.00 | 1.00 | 1.10 | 1.00 | 1.00 | 0.70 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.140 | 0.278 | 0.290 | 0.031 | 0.000 | 0.257 | 1.636 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 25 | 66 | 33 | 28 | 0 | 26 | 43 | 0 |
| N.S. |
1 | 1.00 | 1.67 | 4.40 | 2.20 | 1.87 | 0.00 | 1.73 | 2.87 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.037 | 0.162 | 0.275 | 0.299 | 0.000 | 0.001 | 0.286 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 19 | 19 | 42 | 58 | 32 | 25 | 20 | 24 | 37 | 17 |
| N.S. | 1 | 1.00 | 2.21 | 3.05 | 1.68 | 1.32 | 1.05 | 1.26 | 1.95 | 0.89 |
| time (sec) |
N/A | 0.004 | 0.004 | 0.143 | 0.256 | 0.292 | 0.686 | 0.001 | 0.280 | 2.343 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 25 | 65 | 30 | 28 | 0 | 26 | 44 | 0 |
| N.S. |
1 | 1.00 | 1.19 | 3.10 | 1.43 | 1.33 | 0.00 | 1.24 | 2.10 | 0.00 |
| time (sec) |
N/A | 0.004 | 0.036 | 0.153 | 0.269 | 0.287 | 0.000 | 0.001 | 0.286 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 11 | 11 | 25 | 57 | 26 | 26 | 75 | 26 | 50 | 69 |
| N.S. | 1 | 1.00 | 2.27 | 5.18 | 2.36 | 2.36 | 6.82 | 2.36 | 4.55 | 6.27 |
| time (sec) |
N/A | 0.002 | 0.002 | 0.154 | 0.280 | 0.302 | 16.780 | 0.002 | 0.002 | 15.023 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 21 | 21 | 25 | 66 | 33 | 28 | 0 | 26 | 50 | 0 |
| N.S. |
1 | 1.00 | 1.19 | 3.14 | 1.57 | 1.33 | 0.00 | 1.24 | 2.38 | 0.00 |
| time (sec) |
N/A | 0.006 | 0.036 | 0.155 | 0.273 | 0.297 | 0.000 | 0.001 | 0.283 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 26 | 65 | 21 | 44 | 0 | 23 | 44 | 0 |
| N.S. |
1 | 1.00 | 1.62 | 4.06 | 1.31 | 2.75 | 0.00 | 1.44 | 2.75 | 0.00 |
| time (sec) |
N/A | 0.010 | 0.041 | 0.161 | 0.353 | 0.300 | 0.000 | 0.002 | 0.084 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | A | B | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 11 | 11 | 39 | 56 | 9 | 31 | 76 | 19 | 44 | 69 |
| N.S. | 1 | 1.00 | 3.55 | 5.09 | 0.82 | 2.82 | 6.91 | 1.73 | 4.00 | 6.27 |
| time (sec) |
N/A | 0.003 | 0.033 | 0.161 | 0.348 | 0.288 | 17.166 | 0.002 | 0.078 | 15.093 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 26 | 66 | 19 | 43 | 0 | 23 | 40 | 0 |
| N.S. |
1 | 1.00 | 1.62 | 4.12 | 1.19 | 2.69 | 0.00 | 1.44 | 2.50 | 0.00 |
| time (sec) |
N/A | 0.010 | 0.041 | 0.169 | 0.340 | 0.307 | 0.000 | 0.002 | 0.320 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | A | B | C | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 10 | 10 | 57 | 58 | 18 | 26 | 24 | 21 | 34 | 17 |
| N.S. | 1 | 1.00 | 5.70 | 5.80 | 1.80 | 2.60 | 2.40 | 2.10 | 3.40 | 1.70 |
| time (sec) |
N/A | 0.007 | 0.014 | 0.148 | 0.365 | 0.295 | 0.827 | 0.001 | 0.293 | 2.322 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | A | B | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 11 | 11 | 59 | 66 | 21 | 44 | 0 | 16 | 41 | 0 |
| N.S. |
1 | 1.00 | 5.36 | 6.00 | 1.91 | 4.00 | 0.00 | 1.45 | 3.73 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.015 | 0.166 | 0.352 | 0.299 | 0.000 | 0.001 | 0.303 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | C | C | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 29 | 29 | 28 | 26 | 16 | 1 | 87 | 17 | 47 | 153 |
| N.S. | 1 | 1.00 | 0.97 | 0.90 | 0.55 | 0.03 | 3.00 | 0.59 | 1.62 | 5.28 |
| time (sec) |
N/A | 0.003 | 0.006 | 0.241 | 0.255 | 0.291 | 1.140 | 0.001 | 0.069 | 3.367 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | F | C | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 26 | 26 | 26 | 66 | 21 | 44 | 0 | 28 | 47 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 2.54 | 0.81 | 1.69 | 0.00 | 1.08 | 1.81 | 0.00 |
| time (sec) |
N/A | 0.011 | 0.034 | 0.160 | 0.379 | 0.316 | 0.000 | 0.001 | 0.297 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 59 | 70 | 33 | 30 | 0 | 27 | 49 | 0 |
| N.S. |
1 | 1.00 | 3.69 | 4.38 | 2.06 | 1.88 | 0.00 | 1.69 | 3.06 | 0.00 |
| time (sec) |
N/A | 0.004 | 0.040 | 0.159 | 0.273 | 0.298 | 0.000 | 0.001 | 0.312 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 12 | 12 | 12 | 13 | 11 | 11 | 8 | 11 | 11 | 11 |
| N.S. | 1 | 1.00 | 1.00 | 1.08 | 0.92 | 0.92 | 0.67 | 0.92 | 0.92 | 0.92 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.148 | 0.278 | 0.284 | 0.034 | 0.000 | 0.034 | 1.692 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 59 | 70 | 33 | 30 | 0 | 27 | 45 | 0 |
| N.S. |
1 | 1.00 | 3.69 | 4.38 | 2.06 | 1.88 | 0.00 | 1.69 | 2.81 | 0.00 |
| time (sec) |
N/A | 0.004 | 0.040 | 0.162 | 0.280 | 0.291 | 0.000 | 0.002 | 0.311 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 48 | 64 | 32 | 27 | 51 | 25 | 39 | 43 |
| N.S. | 1 | 1.00 | 2.40 | 3.20 | 1.60 | 1.35 | 2.55 | 1.25 | 1.95 | 2.15 |
| time (sec) |
N/A | 0.004 | 0.005 | 0.142 | 0.259 | 0.292 | 0.755 | 0.001 | 0.282 | 2.610 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 27 | 70 | 33 | 30 | 0 | 27 | 46 | 0 |
| N.S. |
1 | 1.00 | 1.23 | 3.18 | 1.50 | 1.36 | 0.00 | 1.23 | 2.09 | 0.00 |
| time (sec) |
N/A | 0.006 | 0.037 | 0.158 | 0.275 | 0.292 | 0.000 | 0.002 | 0.285 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 12 | 12 | 27 | 61 | 26 | 28 | 78 | 27 | 52 | 71 |
| N.S. | 1 | 1.00 | 2.25 | 5.08 | 2.17 | 2.33 | 6.50 | 2.25 | 4.33 | 5.92 |
| time (sec) |
N/A | 0.002 | 0.037 | 0.163 | 0.305 | 0.288 | 16.508 | 0.002 | 0.294 | 15.845 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 27 | 69 | 30 | 30 | 0 | 27 | 52 | 0 |
| N.S. |
1 | 1.00 | 1.23 | 3.14 | 1.36 | 1.36 | 0.00 | 1.23 | 2.36 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.037 | 0.171 | 0.254 | 0.291 | 0.000 | 0.002 | 0.292 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | C | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 11 | 11 | 25 | 57 | 26 | 26 | 75 | 26 | 40 | 69 |
| N.S. | 1 | 1.00 | 2.27 | 5.18 | 2.36 | 2.36 | 6.82 | 2.36 | 3.64 | 6.27 |
| time (sec) |
N/A | 0.002 | 0.035 | 0.168 | 0.252 | 0.292 | 17.289 | 0.001 | 0.324 | 16.029 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 51 | 100 | 0 | 175 | 0 | 57 | 66 | 0 |
| N.S. |
1 | 1.00 | 1.19 | 2.33 | 0.00 | 4.07 | 0.00 | 1.33 | 1.53 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.053 | 0.189 | 0.000 | 0.310 | 0.000 | 0.015 | 0.495 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 30 | 48 | 41 | 26 | 42 | 33 | 30 | 34 |
| N.S. | 1 | 1.00 | 1.36 | 2.18 | 1.86 | 1.18 | 1.91 | 1.50 | 1.36 | 1.55 |
| time (sec) |
N/A | 0.003 | 0.032 | 0.162 | 0.379 | 0.294 | 0.547 | 0.004 | 0.439 | 2.160 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 26 | 26 | 26 | 57 | 28 | 46 | 56 | 46 | 43 | 43 |
| N.S. | 1 | 1.00 | 1.00 | 2.19 | 1.08 | 1.77 | 2.15 | 1.77 | 1.65 | 1.65 |
| time (sec) |
N/A | 0.009 | 0.058 | 0.172 | 0.363 | 0.294 | 0.658 | 0.002 | 0.122 | 2.371 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 42 | 42 | 58 | 109 | 0 | 176 | 0 | 60 | 63 | 0 |
| N.S. |
1 | 1.00 | 1.38 | 2.60 | 0.00 | 4.19 | 0.00 | 1.43 | 1.50 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.064 | 0.183 | 0.000 | 0.313 | 0.000 | 0.015 | 0.515 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | B | B | B | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 10 | 10 | 38 | 27 | 14 | 14 | 24 | 15 | 16 | 23 |
| N.S. | 1 | 1.00 | 3.80 | 2.70 | 1.40 | 1.40 | 2.40 | 1.50 | 1.60 | 2.30 |
| time (sec) |
N/A | 0.006 | 0.026 | 0.151 | 0.348 | 0.295 | 0.496 | 0.002 | 0.290 | 2.075 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | A | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 38 | 31 | 21 | 21 | 42 | 27 | 27 | 34 |
| N.S. | 1 | 1.00 | 1.90 | 1.55 | 1.05 | 1.05 | 2.10 | 1.35 | 1.35 | 1.70 |
| time (sec) |
N/A | 0.005 | 0.050 | 0.151 | 0.337 | 0.291 | 0.546 | 0.002 | 0.295 | 2.198 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | A | A | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 26 | 26 | 31 | 39 | 11 | 44 | 56 | 35 | 40 | 43 |
| N.S. | 1 | 1.00 | 1.19 | 1.50 | 0.42 | 1.69 | 2.15 | 1.35 | 1.54 | 1.65 |
| time (sec) |
N/A | 0.008 | 0.044 | 0.167 | 0.361 | 0.295 | 0.603 | 0.003 | 0.080 | 2.355 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F(-2) | B | F | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 43 | 43 | 43 | 84 | 0 | 185 | 0 | 66 | 44 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 1.95 | 0.00 | 4.30 | 0.00 | 1.53 | 1.02 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.065 | 0.167 | 0.000 | 0.311 | 0.000 | 0.005 | 0.343 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 457 | 457 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.16 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.452 | 10.048 | 0.006 | 0.000 | 0.343 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 419 | 419 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.17 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.269 | 10.024 | 0.004 | 0.000 | 0.326 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 381 | 381 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.19 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.194 | 10.021 | 0.005 | 0.000 | 0.323 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 366 | 366 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.19 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.193 | 10.018 | 0.057 | 0.000 | 0.325 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 417 | 417 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.18 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.273 | 10.026 | 0.064 | 0.000 | 0.326 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 457 | 457 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.16 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.316 | 10.031 | 0.057 | 0.000 | 0.325 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 839 | 839 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.677 | 10.036 | 0.007 | 0.000 | 0.373 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 804 | 804 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.472 | 10.022 | 0.005 | 0.000 | 0.369 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 762 | 762 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.410 | 10.017 | 0.059 | 0.000 | 0.366 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 796 | 796 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.493 | 10.019 | 0.061 | 0.000 | 0.361 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 842 | 842 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.574 | 10.022 | 0.062 | 0.000 | 0.359 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 416 | 416 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.18 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.284 | 10.033 | 0.006 | 0.000 | 0.331 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 381 | 381 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.19 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.210 | 10.028 | 0.004 | 0.000 | 0.330 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 345 | 345 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.21 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.161 | 10.034 | 0.056 | 0.000 | 0.325 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 383 | 383 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.19 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.212 | 10.020 | 0.055 | 0.000 | 0.317 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 421 | 421 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.17 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.278 | 10.030 | 0.059 | 0.000 | 0.325 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 219 | 219 | 220 | 0 | 0 | 717 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 3.27 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.061 | 0.517 | 0.004 | 0.000 | 0.321 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 172 | 172 | 278 | 0 | 0 | 596 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.62 | 0.00 | 0.00 | 3.47 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.031 | 5.653 | 0.004 | 0.000 | 0.319 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 149 | 149 | 191 | 0 | 0 | 233 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.28 | 0.00 | 0.00 | 1.56 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.158 | 0.068 | 0.000 | 0.299 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 32 | 27 | 0 | 65 | 0 | 0 | 92 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.84 | 0.00 | 2.03 | 0.00 | 0.00 | 2.88 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.033 | 0.181 | 0.000 | 0.289 | 0.000 | 0.000 | 0.713 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 54 | 0 | 175 | 0 | 0 | 127 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.82 | 0.00 | 2.65 | 0.00 | 0.00 | 1.92 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.084 | 0.192 | 0.000 | 0.296 | 0.000 | 0.000 | 1.032 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 73 | 105 | 0 | 337 | 0 | 0 | 203 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 1.04 | 0.00 | 3.34 | 0.00 | 0.00 | 2.01 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.104 | 0.167 | 0.000 | 0.305 | 0.000 | 0.000 | 1.017 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-2) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 95 | 171 | 0 | 533 | 0 | 0 | 293 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.26 | 0.00 | 3.92 | 0.00 | 0.00 | 2.15 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.125 | 0.206 | 0.000 | 0.298 | 0.000 | 0.000 | 1.152 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 655 | 655 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.11 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.947 | 10.027 | 0.006 | 0.000 | 0.301 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 617 | 617 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.12 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.579 | 10.024 | 0.003 | 0.000 | 0.306 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 576 | 576 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.12 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.402 | 10.026 | 0.004 | 0.000 | 0.303 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 568 | 568 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.13 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.420 | 10.018 | 0.055 | 0.000 | 0.314 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 617 | 617 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.12 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.575 | 10.027 | 0.053 | 0.000 | 0.301 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 216 | 216 | 231 | 0 | 0 | 740 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.07 | 0.00 | 0.00 | 3.43 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.062 | 0.488 | 0.005 | 0.000 | 0.323 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 171 | 171 | 278 | 0 | 0 | 618 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.63 | 0.00 | 0.00 | 3.61 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.029 | 5.821 | 0.003 | 0.000 | 0.322 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 126 | 126 | 155 | 0 | 0 | 519 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.23 | 0.00 | 0.00 | 4.12 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.011 | 0.133 | 0.064 | 0.000 | 0.309 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 32 | 27 | 0 | 42 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.84 | 0.00 | 1.31 | 0.00 | 0.00 | -0.03 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.031 | 0.184 | 0.000 | 0.287 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 54 | 0 | 118 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.82 | 0.00 | 1.79 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.115 | 0.164 | 0.000 | 0.304 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 73 | 105 | 0 | 251 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 1.04 | 0.00 | 2.49 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.132 | 0.178 | 0.000 | 0.331 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 95 | 171 | 0 | 420 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.26 | 0.00 | 3.09 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.154 | 0.214 | 0.000 | 0.373 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1365 | 1365 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 1.918 | 10.042 | 0.053 | 0.000 | 0.325 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1330 | 1330 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 1.401 | 10.025 | 0.056 | 0.000 | 0.307 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1293 | 1293 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.06 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 1.118 | 10.026 | 0.053 | 0.000 | 0.321 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1257 | 1257 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.06 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.850 | 10.022 | 0.065 | 0.000 | 0.307 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1297 | 1297 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 1.103 | 10.024 | 0.057 | 0.000 | 0.307 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1335 | 1335 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 1.368 | 10.025 | 0.061 | 0.000 | 0.314 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1372 | 1372 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 1.670 | 10.019 | 0.061 | 0.000 | 0.316 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 216 | 216 | 231 | 0 | 0 | 741 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.07 | 0.00 | 0.00 | 3.43 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.055 | 0.325 | 0.006 | 0.000 | 0.320 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 169 | 169 | 278 | 0 | 0 | 619 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.64 | 0.00 | 0.00 | 3.66 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.027 | 6.548 | 0.005 | 0.000 | 0.321 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 126 | 126 | 155 | 0 | 0 | 521 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.23 | 0.00 | 0.00 | 4.13 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.010 | 0.121 | 0.061 | 0.000 | 0.306 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 27 | 0 | 42 | 0 | 0 | 26 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.90 | 0.00 | 1.40 | 0.00 | 0.00 | 0.87 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.035 | 0.177 | 0.000 | 0.292 | 0.000 | 0.000 | 0.828 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 54 | 0 | 118 | 0 | 0 | 71 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.82 | 0.00 | 1.79 | 0.00 | 0.00 | 1.08 | 0.00 |
| time (sec) |
N/A | 0.006 | 0.083 | 0.243 | 0.000 | 0.294 | 0.000 | 0.000 | 0.977 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 75 | 105 | 0 | 251 | 0 | 0 | 133 | 0 |
| N.S. |
1 | 1.00 | 0.74 | 1.04 | 0.00 | 2.49 | 0.00 | 0.00 | 1.32 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.095 | 0.171 | 0.000 | 0.298 | 0.000 | 0.000 | 1.508 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 95 | 171 | 0 | 419 | 0 | 0 | 209 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.26 | 0.00 | 3.08 | 0.00 | 0.00 | 1.54 | 0.00 |
| time (sec) |
N/A | 0.020 | 0.124 | 0.188 | 0.000 | 0.296 | 0.000 | 0.000 | 1.273 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 649 | 649 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.11 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.752 | 10.033 | 0.007 | 0.000 | 0.300 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 614 | 614 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.12 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.577 | 10.034 | 0.008 | 0.000 | 0.302 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 577 | 577 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.13 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.385 | 10.029 | 0.004 | 0.000 | 0.302 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 542 | 542 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.13 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.308 | 10.023 | 0.059 | 0.000 | 0.300 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 586 | 586 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.12 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.397 | 10.024 | 0.062 | 0.000 | 0.305 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 621 | 621 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.12 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.588 | 10.023 | 0.070 | 0.000 | 0.314 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 656 | 656 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.11 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.739 | 10.033 | 0.066 | 0.000 | 0.309 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 241 | 241 | 267 | 0 | 0 | 423 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.11 | 0.00 | 0.00 | 1.76 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.075 | 0.484 | 0.009 | 0.000 | 0.308 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | A | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 195 | 195 | 245 | 0 | 0 | 306 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.26 | 0.00 | 0.00 | 1.57 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.048 | 10.089 | 0.007 | 0.000 | 0.307 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 149 | 149 | 191 | 0 | 0 | 233 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.28 | 0.00 | 0.00 | 1.56 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.179 | 0.056 | 0.000 | 0.302 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 27 | 0 | 42 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.90 | 0.00 | 1.40 | 0.00 | 0.00 | -0.03 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.034 | 0.197 | 0.000 | 0.300 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 45 | 53 | 0 | 126 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 0.80 | 0.00 | 1.91 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.086 | 0.165 | 0.000 | 0.300 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 71 | 105 | 0 | 273 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.04 | 0.00 | 2.70 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.105 | 0.169 | 0.000 | 0.303 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 95 | 171 | 0 | 456 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.26 | 0.00 | 3.35 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.118 | 0.168 | 0.000 | 0.327 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1355 | 1355 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 1.726 | 10.046 | 0.060 | 0.000 | 0.322 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1317 | 1317 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.06 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 1.373 | 10.042 | 0.058 | 0.000 | 0.316 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1279 | 1279 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.06 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 1.061 | 10.035 | 0.055 | 0.000 | 0.326 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1298 | 1298 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.06 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 1.067 | 10.025 | 0.065 | 0.000 | 0.315 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1327 | 1327 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 1.397 | 10.040 | 0.062 | 0.000 | 0.312 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | NO | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 1370 | 1370 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 1.643 | 10.029 | 0.063 | 0.000 | 0.321 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | B | C | F | A | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 77 | 77 | 158 | 577 | 0 | 107 | 39 | 0 | -1 | 25 |
| N.S. | 1 | 1.00 | 2.05 | 7.49 | 0.00 | 1.39 | 0.51 | 0.00 | -0.01 | 0.32 |
| time (sec) |
N/A | 0.011 | 0.184 | 0.436 | 0.000 | 0.302 | 1.715 | 0.000 | 0.000 | 3.361 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 185 | 185 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.39 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.148 | 10.052 | 0.006 | 0.000 | 0.313 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 147 | 147 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.50 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.066 | 10.033 | 0.004 | 0.000 | 0.308 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 111 | 111 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.64 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.047 | 10.018 | 0.006 | 0.000 | 0.307 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 104 | 104 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.045 | 10.025 | 0.056 | 0.000 | 0.320 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 145 | 145 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.50 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.065 | 10.041 | 0.053 | 0.000 | 0.314 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 185 | 185 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.39 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.088 | 10.023 | 0.055 | 0.000 | 0.311 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 270 | 270 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.27 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.255 | 10.051 | 0.007 | 0.000 | 0.324 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 232 | 232 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.31 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.177 | 10.036 | 0.004 | 0.000 | 0.319 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 196 | 196 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.36 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.158 | 10.034 | 0.007 | 0.000 | 0.330 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 184 | 184 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.39 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.152 | 10.025 | 0.060 | 0.000 | 0.327 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 221 | 221 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.33 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.165 | 10.053 | 0.058 | 0.000 | 0.322 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 270 | 270 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.27 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.196 | 10.041 | 0.054 | 0.000 | 0.320 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 220 | 220 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.33 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.125 | 10.058 | 0.008 | 0.000 | 0.322 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | A | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 182 | 182 | 73 | 0 | 0 | 0 | 218 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.40 | 0.00 | 0.00 | 0.00 | 1.20 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.077 | 10.036 | 0.005 | 0.000 | 0.325 | 10.370 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 144 | 144 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.49 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.061 | 10.037 | 0.008 | 0.000 | 0.314 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 132 | 132 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.54 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.055 | 10.044 | 0.010 | 0.000 | 0.313 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 135 | 135 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.54 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.053 | 10.056 | 0.067 | 0.000 | 0.327 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 175 | 175 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.42 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.070 | 10.054 | 0.059 | 0.000 | 0.333 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 213 | 213 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.34 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.078 | 10.065 | 0.056 | 0.000 | 0.351 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 264 | 264 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.28 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.197 | 10.038 | 0.009 | 0.000 | 0.321 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 229 | 229 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.32 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.170 | 10.025 | 0.005 | 0.000 | 0.326 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 196 | 196 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.37 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.151 | 10.026 | 0.005 | 0.000 | 0.318 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 167 | 167 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.43 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.136 | 10.018 | 0.059 | 0.000 | 0.317 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 191 | 191 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.37 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.147 | 10.031 | 0.067 | 0.000 | 0.311 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 224 | 224 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.33 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.155 | 10.045 | 0.066 | 0.000 | 0.325 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 144 | 144 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.51 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.056 | 10.034 | 0.007 | 0.000 | 0.318 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 111 | 111 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.66 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.044 | 10.032 | 0.005 | 0.000 | 0.302 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 83 | 83 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.86 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.036 | 10.032 | 0.063 | 0.000 | 0.312 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 111 | 111 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.64 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.045 | 10.025 | 0.084 | 0.000 | 0.307 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 149 | 149 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.49 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.057 | 10.047 | 0.066 | 0.000 | 0.305 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 254 | 254 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.29 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.184 | 10.047 | 0.011 | 0.000 | 0.328 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 220 | 220 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.33 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.163 | 10.045 | 0.007 | 0.000 | 0.326 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 190 | 190 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.38 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.146 | 10.031 | 0.060 | 0.000 | 0.318 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 197 | 197 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.36 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.152 | 10.029 | 0.059 | 0.000 | 0.315 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 222 | 222 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.32 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.163 | 10.037 | 0.062 | 0.000 | 0.320 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 261 | 261 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.28 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.188 | 10.058 | 0.065 | 0.000 | 0.321 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 207 | 207 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.35 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.098 | 10.056 | 0.010 | 0.000 | 0.312 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 137 | 137 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.53 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.055 | 10.036 | 0.008 | 0.000 | 0.311 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 111 | 111 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.66 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.044 | 10.030 | 0.061 | 0.000 | 0.305 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 118 | 118 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.60 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.045 | 10.039 | 0.064 | 0.000 | 0.305 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 146 | 146 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.49 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.055 | 10.041 | 0.067 | 0.000 | 0.310 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 178 | 178 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.41 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.073 | 10.054 | 0.071 | 0.000 | 0.321 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F(-1) | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 286 | 286 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.26 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.211 | 10.065 | 0.012 | 0.000 | 0.364 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 248 | 248 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.29 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.187 | 10.060 | 0.010 | 0.000 | 0.334 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 222 | 222 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.33 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.162 | 10.049 | 0.064 | 0.000 | 0.316 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 232 | 232 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.31 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.166 | 10.047 | 0.064 | 0.000 | 0.327 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 236 | 236 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.30 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.168 | 10.042 | 0.061 | 0.000 | 0.327 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 262 | 262 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.27 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.186 | 10.035 | 0.063 | 0.000 | 0.349 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 303 | 303 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.24 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.214 | 10.043 | 0.087 | 0.000 | 0.348 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 205 | 205 | 174 | 0 | 0 | 2151 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.85 | 0.00 | 0.00 | 10.49 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.099 | 0.505 | 0.006 | 0.000 | 0.421 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 167 | 167 | 143 | 0 | 0 | 1468 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.86 | 0.00 | 0.00 | 8.79 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.073 | 0.386 | 0.007 | 0.000 | 0.376 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 152 | 152 | 71 | 0 | 0 | 857 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.47 | 0.00 | 0.00 | 5.64 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.068 | 10.044 | 0.007 | 0.000 | 0.354 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 134 | 134 | 122 | 0 | 0 | 368 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.91 | 0.00 | 0.00 | 2.75 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.062 | 0.270 | 0.059 | 0.000 | 0.332 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 32 | 27 | 0 | 104 | 0 | 0 | 99 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.84 | 0.00 | 3.25 | 0.00 | 0.00 | 3.09 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.046 | 0.173 | 0.000 | 0.326 | 0.000 | 0.000 | 0.810 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-2) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 54 | 0 | 235 | 0 | 0 | 178 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.82 | 0.00 | 3.56 | 0.00 | 0.00 | 2.70 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.130 | 0.225 | 0.000 | 0.368 | 0.000 | 0.000 | 0.955 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 73 | 105 | 0 | 426 | 0 | 0 | 268 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 1.04 | 0.00 | 4.22 | 0.00 | 0.00 | 2.65 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.157 | 0.218 | 0.000 | 0.382 | 0.000 | 0.000 | 1.126 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 95 | 171 | 0 | 649 | 0 | 0 | 376 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.26 | 0.00 | 4.77 | 0.00 | 0.00 | 2.76 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.176 | 0.171 | 0.000 | 0.456 | 0.000 | 0.000 | 1.360 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 408 | 408 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.18 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.412 | 10.048 | 0.006 | 0.000 | 0.321 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 370 | 370 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.20 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.265 | 10.042 | 0.006 | 0.000 | 0.306 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 332 | 332 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.21 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.208 | 10.036 | 0.006 | 0.000 | 0.320 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 325 | 325 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.22 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.201 | 10.038 | 0.008 | 0.000 | 0.319 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 325 | 325 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.22 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.218 | 10.039 | 0.062 | 0.000 | 0.326 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 363 | 363 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.20 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.252 | 10.046 | 0.059 | 0.000 | 0.349 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 401 | 401 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.18 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.310 | 10.052 | 0.060 | 0.000 | 0.388 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 167 | 167 | 143 | 0 | 0 | 1468 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.86 | 0.00 | 0.00 | 8.79 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.071 | 0.341 | 0.006 | 0.000 | 0.379 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 127 | 127 | 129 | 0 | 0 | 814 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.02 | 0.00 | 0.00 | 6.41 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.050 | 6.506 | 0.003 | 0.000 | 0.337 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 85 | 85 | 73 | 0 | 0 | 234 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.86 | 0.00 | 0.00 | 2.75 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.040 | 0.084 | 0.065 | 0.000 | 0.320 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 32 | 27 | 0 | 42 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.84 | 0.00 | 1.31 | 0.00 | 0.00 | -0.03 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.031 | 0.189 | 0.000 | 0.327 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 54 | 0 | 118 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.82 | 0.00 | 1.79 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.114 | 0.218 | 0.000 | 0.425 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 73 | 105 | 0 | 252 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 1.04 | 0.00 | 2.50 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.133 | 0.209 | 0.000 | 0.647 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 95 | 171 | 0 | 419 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.26 | 0.00 | 3.08 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.156 | 0.210 | 0.000 | 1.260 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 751 | 751 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.556 | 10.031 | 0.059 | 0.000 | 0.343 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 705 | 705 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.439 | 10.033 | 0.057 | 0.000 | 0.338 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 688 | 688 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.11 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.362 | 10.023 | 0.061 | 0.000 | 0.337 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 718 | 718 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.443 | 10.028 | 0.064 | 0.000 | 0.355 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 760 | 760 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.531 | 10.032 | 0.067 | 0.000 | 0.334 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 167 | 167 | 143 | 0 | 0 | 1457 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.86 | 0.00 | 0.00 | 8.72 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.072 | 0.239 | 0.006 | 0.000 | 0.372 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 127 | 127 | 131 | 0 | 0 | 808 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.03 | 0.00 | 0.00 | 6.36 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.058 | 7.411 | 0.004 | 0.000 | 0.340 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 85 | 85 | 73 | 0 | 0 | 234 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.86 | 0.00 | 0.00 | 2.75 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.047 | 0.084 | 0.067 | 0.000 | 0.313 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 27 | 0 | 42 | 0 | 0 | 26 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.90 | 0.00 | 1.40 | 0.00 | 0.00 | 0.87 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.037 | 0.185 | 0.000 | 0.293 | 0.000 | 0.000 | 0.706 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 54 | 0 | 118 | 0 | 0 | 71 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.82 | 0.00 | 1.79 | 0.00 | 0.00 | 1.08 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.085 | 0.187 | 0.000 | 0.292 | 0.000 | 0.000 | 0.868 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 75 | 105 | 0 | 251 | 0 | 0 | 133 | 0 |
| N.S. |
1 | 1.00 | 0.74 | 1.04 | 0.00 | 2.49 | 0.00 | 0.00 | 1.32 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.100 | 0.204 | 0.000 | 0.303 | 0.000 | 0.000 | 1.020 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 93 | 171 | 0 | 419 | 0 | 0 | 209 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 1.26 | 0.00 | 3.08 | 0.00 | 0.00 | 1.54 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.134 | 0.181 | 0.000 | 0.308 | 0.000 | 0.000 | 1.260 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 332 | 332 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.22 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.212 | 10.027 | 0.007 | 0.000 | 0.353 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 295 | 295 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.25 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.172 | 10.023 | 0.004 | 0.000 | 0.311 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 270 | 270 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.26 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.136 | 10.021 | 0.072 | 0.000 | 0.325 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 306 | 306 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.24 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.168 | 10.034 | 0.069 | 0.000 | 0.301 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 339 | 339 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.22 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.210 | 10.025 | 0.069 | 0.000 | 0.348 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 152 | 152 | 73 | 0 | 0 | 857 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.48 | 0.00 | 0.00 | 5.64 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.065 | 10.046 | 0.007 | 0.000 | 0.383 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 108 | 108 | 105 | 0 | 0 | 273 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.97 | 0.00 | 0.00 | 2.53 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.047 | 0.123 | 0.056 | 0.000 | 0.309 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 27 | 0 | 42 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.90 | 0.00 | 1.40 | 0.00 | 0.00 | -0.03 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.037 | 0.212 | 0.000 | 0.300 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 45 | 53 | 0 | 126 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 0.80 | 0.00 | 1.91 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.087 | 0.175 | 0.000 | 0.295 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 73 | 105 | 0 | 273 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 1.04 | 0.00 | 2.70 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.107 | 0.193 | 0.000 | 0.422 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 95 | 171 | 0 | 457 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.26 | 0.00 | 3.36 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.021 | 0.121 | 0.211 | 0.000 | 0.618 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F(-1) | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 776 | 776 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.631 | 10.056 | 0.069 | 0.000 | 0.340 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 730 | 730 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.539 | 10.043 | 0.069 | 0.000 | 0.369 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 712 | 712 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.455 | 10.036 | 0.061 | 0.000 | 0.352 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 719 | 719 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.447 | 10.035 | 0.067 | 0.000 | 0.355 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 750 | 750 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.546 | 10.038 | 0.071 | 0.000 | 0.345 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 795 | 795 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.641 | 10.035 | 0.072 | 0.000 | 0.348 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | A | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 279 | 279 | 156 | 0 | 0 | 247 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.56 | 0.00 | 0.00 | 0.89 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.219 | 0.196 | 0.068 | 0.000 | 0.336 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 193 | 193 | 96 | 0 | 0 | 448 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.50 | 0.00 | 0.00 | 2.32 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.096 | 0.103 | 0.059 | 0.000 | 0.334 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.019 | 10.024 | 0.008 | 0.000 | 1.718 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.029 | 0.006 | 0.000 | 1.740 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.014 | 10.026 | 0.062 | 0.000 | 1.680 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.028 | 0.061 | 0.000 | 1.735 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.014 | 10.025 | 0.064 | 0.000 | 1.591 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 487 | 487 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.15 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.403 | 10.066 | 0.006 | 0.000 | 0.382 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 449 | 449 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.16 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.249 | 10.023 | 0.006 | 0.000 | 0.359 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 411 | 411 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.18 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.210 | 10.021 | 0.005 | 0.000 | 0.346 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 375 | 375 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.19 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.173 | 10.027 | 0.006 | 0.000 | 0.345 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 367 | 367 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.19 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.173 | 10.034 | 0.060 | 0.000 | 0.340 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 409 | 409 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.18 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.206 | 10.049 | 0.059 | 0.000 | 0.364 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 896 | 896 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.08 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.777 | 10.032 | 0.006 | 0.000 | 0.421 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 858 | 858 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.573 | 10.026 | 0.005 | 0.000 | 0.425 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 817 | 817 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.495 | 10.040 | 0.006 | 0.000 | 0.423 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 798 | 798 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.462 | 10.028 | 0.061 | 0.000 | 0.429 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 854 | 854 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.552 | 10.047 | 0.058 | 0.000 | 0.421 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 896 | 896 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.08 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.635 | 10.037 | 0.054 | 0.000 | 0.437 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 890 | 890 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.08 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.649 | 10.026 | 0.007 | 0.000 | 0.469 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 855 | 855 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.534 | 10.022 | 0.006 | 0.000 | 0.420 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 820 | 820 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.464 | 10.022 | 0.004 | 0.000 | 0.432 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 780 | 780 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.399 | 10.024 | 0.059 | 0.000 | 0.408 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 813 | 813 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.459 | 10.037 | 0.060 | 0.000 | 0.426 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 858 | 858 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.519 | 10.057 | 0.064 | 0.000 | 0.409 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 440 | 440 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.17 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.236 | 10.034 | 0.008 | 0.000 | 0.336 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 405 | 405 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.18 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.199 | 10.033 | 0.007 | 0.000 | 0.337 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 372 | 372 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.20 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.169 | 10.032 | 0.005 | 0.000 | 0.361 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 343 | 343 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.21 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.137 | 10.025 | 0.055 | 0.000 | 0.341 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 372 | 372 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.19 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.162 | 10.019 | 0.056 | 0.000 | 0.358 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 410 | 410 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.18 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.205 | 10.040 | 0.059 | 0.000 | 0.351 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 880 | 880 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.08 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.649 | 10.054 | 0.008 | 0.000 | 0.456 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 844 | 844 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.561 | 10.043 | 0.007 | 0.000 | 0.437 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 806 | 806 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.479 | 10.041 | 0.057 | 0.000 | 0.461 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 817 | 817 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.484 | 10.037 | 0.060 | 0.000 | 0.451 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 844 | 844 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.08 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.552 | 10.039 | 0.059 | 0.000 | 0.445 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 893 | 893 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.08 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.616 | 10.054 | 0.062 | 0.000 | 0.429 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.87 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 10.060 | 0.005 | 0.000 | 0.329 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.89 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 10.038 | 0.004 | 0.000 | 0.356 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.032 | 0.003 | 0.000 | 0.329 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.034 | 0.003 | 0.000 | 0.376 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.90 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.055 | 0.056 | 0.000 | 0.342 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 81 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 10.033 | 0.063 | 0.000 | 0.329 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 427 | 427 | 267 | 0 | 0 | 5633 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.63 | 0.00 | 0.00 | 13.19 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.446 | 0.805 | 0.005 | 0.000 | 0.435 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 378 | 378 | 291 | 0 | 0 | 3025 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.77 | 0.00 | 0.00 | 8.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.357 | 10.209 | 0.005 | 0.000 | 0.447 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 332 | 332 | 239 | 0 | 0 | 663 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 0.00 | 0.00 | 2.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.341 | 0.249 | 0.054 | 0.000 | 0.357 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 32 | 27 | 0 | 65 | 0 | 0 | 130 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.84 | 0.00 | 2.03 | 0.00 | 0.00 | 4.06 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.033 | 0.171 | 0.000 | 0.300 | 0.000 | 0.000 | 0.565 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-2) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 54 | 0 | 175 | 0 | 0 | 137 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.82 | 0.00 | 2.65 | 0.00 | 0.00 | 2.08 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.119 | 0.199 | 0.000 | 0.328 | 0.000 | 0.000 | 0.750 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 73 | 105 | 0 | 338 | 0 | 0 | 213 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 1.04 | 0.00 | 3.35 | 0.00 | 0.00 | 2.11 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.137 | 0.171 | 0.000 | 0.361 | 0.000 | 0.000 | 0.949 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 95 | 171 | 0 | 533 | 0 | 0 | 302 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.26 | 0.00 | 3.92 | 0.00 | 0.00 | 2.22 | 0.00 |
| time (sec) |
N/A | 0.025 | 0.157 | 0.210 | 0.000 | 0.341 | 0.000 | 0.000 | 1.147 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 427 | 427 | 267 | 0 | 0 | 5633 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.63 | 0.00 | 0.00 | 13.19 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.445 | 0.771 | 0.004 | 0.000 | 0.444 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 378 | 378 | 73 | 0 | 0 | 2997 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.19 | 0.00 | 0.00 | 7.93 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.398 | 10.035 | 0.003 | 0.000 | 0.400 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 334 | 334 | 244 | 0 | 0 | 755 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.73 | 0.00 | 0.00 | 2.26 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.386 | 0.302 | 0.053 | 0.000 | 0.409 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-2) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 32 | 27 | 0 | 65 | 0 | 0 | 130 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.84 | 0.00 | 2.03 | 0.00 | 0.00 | 4.06 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.041 | 0.175 | 0.000 | 0.340 | 0.000 | 0.000 | 0.587 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 54 | 0 | 175 | 0 | 0 | 137 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.82 | 0.00 | 2.65 | 0.00 | 0.00 | 2.08 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.127 | 0.177 | 0.000 | 0.331 | 0.000 | 0.000 | 0.744 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 73 | 105 | 0 | 338 | 0 | 0 | 214 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 1.04 | 0.00 | 3.35 | 0.00 | 0.00 | 2.12 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.152 | 0.201 | 0.000 | 0.342 | 0.000 | 0.000 | 0.944 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 95 | 171 | 0 | 533 | 0 | 0 | 303 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.26 | 0.00 | 3.92 | 0.00 | 0.00 | 2.23 | 0.00 |
| time (sec) |
N/A | 0.023 | 0.171 | 0.198 | 0.000 | 0.349 | 0.000 | 0.000 | 1.158 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.89 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 10.054 | 0.063 | 0.000 | 0.575 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.026 | 0.053 | 0.000 | 0.606 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.014 | 10.048 | 0.058 | 0.000 | 0.592 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.90 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.014 | 10.044 | 0.055 | 0.000 | 0.570 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.89 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.052 | 0.056 | 0.000 | 0.631 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 81 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.96 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 10.037 | 0.056 | 0.000 | 0.564 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-1) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.87 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 10.077 | 0.006 | 0.000 | 0.362 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.89 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 10.053 | 0.004 | 0.000 | 0.359 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.024 | 0.006 | 0.000 | 0.347 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.028 | 0.006 | 0.000 | 0.387 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.90 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.053 | 0.007 | 0.000 | 0.387 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 81 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 10.043 | 0.064 | 0.000 | 0.354 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 424 | 424 | 288 | 0 | 0 | 5633 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 0.00 | 0.00 | 13.29 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.400 | 0.680 | 0.007 | 0.000 | 0.455 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 403 | 403 | 73 | 0 | 0 | 3084 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.18 | 0.00 | 0.00 | 7.65 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.392 | 10.037 | 0.013 | 0.000 | 0.398 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F(-1) | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 358 | 358 | 257 | 0 | 0 | 855 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 0.00 | 0.00 | 2.39 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.370 | 0.407 | 0.055 | 0.000 | 0.343 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-2) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 32 | 27 | 0 | 104 | 0 | 0 | 199 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.84 | 0.00 | 3.25 | 0.00 | 0.00 | 6.22 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.044 | 0.171 | 0.000 | 0.339 | 0.000 | 0.000 | 0.756 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 54 | 0 | 235 | 0 | 0 | 189 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.82 | 0.00 | 3.56 | 0.00 | 0.00 | 2.86 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.137 | 0.175 | 0.000 | 0.345 | 0.000 | 0.000 | 0.907 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 73 | 105 | 0 | 427 | 0 | 0 | 278 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 1.04 | 0.00 | 4.23 | 0.00 | 0.00 | 2.75 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.162 | 0.201 | 0.000 | 0.360 | 0.000 | 0.000 | 1.144 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 95 | 171 | 0 | 649 | 0 | 0 | 385 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.26 | 0.00 | 4.77 | 0.00 | 0.00 | 2.83 | 0.00 |
| time (sec) |
N/A | 0.023 | 0.198 | 0.175 | 0.000 | 0.322 | 0.000 | 0.000 | 1.429 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 424 | 424 | 278 | 0 | 0 | 5633 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.66 | 0.00 | 0.00 | 13.29 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.453 | 0.699 | 0.006 | 0.000 | 0.413 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 378 | 378 | 73 | 0 | 0 | 3025 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.19 | 0.00 | 0.00 | 8.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.405 | 10.024 | 0.005 | 0.000 | 0.399 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 309 | 309 | 194 | 0 | 0 | 620 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.63 | 0.00 | 0.00 | 2.01 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.363 | 0.169 | 0.055 | 0.000 | 0.334 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 32 | 32 | 32 | 27 | 0 | 42 | 0 | 0 | 27 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.84 | 0.00 | 1.31 | 0.00 | 0.00 | 0.84 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.034 | 0.193 | 0.000 | 0.328 | 0.000 | 0.000 | 0.763 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-2) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 54 | 0 | 118 | 0 | 0 | 127 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.82 | 0.00 | 1.79 | 0.00 | 0.00 | 1.92 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.085 | 0.197 | 0.000 | 0.326 | 0.000 | 0.000 | 0.860 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 73 | 105 | 0 | 252 | 0 | 0 | 203 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 1.04 | 0.00 | 2.50 | 0.00 | 0.00 | 2.01 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.106 | 0.205 | 0.000 | 0.326 | 0.000 | 0.000 | 1.033 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 95 | 171 | 0 | 420 | 0 | 0 | 292 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.26 | 0.00 | 3.09 | 0.00 | 0.00 | 2.15 | 0.00 |
| time (sec) |
N/A | 0.023 | 0.117 | 0.233 | 0.000 | 0.321 | 0.000 | 0.000 | 1.200 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.89 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 10.042 | 0.056 | 0.000 | 0.597 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.052 | 0.056 | 0.000 | 0.574 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 74 | 74 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.017 | 0.051 | 0.000 | 0.600 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 81 | 81 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.90 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 10.029 | 0.052 | 0.000 | 0.560 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.89 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 10.038 | 0.056 | 0.000 | 0.546 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 81 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.96 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 10.047 | 0.060 | 0.000 | 0.555 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.87 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 10.044 | 0.008 | 0.000 | 0.368 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 80 | 80 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.89 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 10.030 | 0.006 | 0.000 | 0.332 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.027 | 0.003 | 0.000 | 0.318 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 10.021 | 0.054 | 0.000 | 0.350 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 79 | 79 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.90 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.045 | 0.058 | 0.000 | 0.328 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-1) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 80 | 80 | 79 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.029 | 0.064 | 0.000 | 0.354 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 424 | 424 | 278 | 0 | 0 | 5591 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.66 | 0.00 | 0.00 | 13.19 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.408 | 0.442 | 0.006 | 0.000 | 0.416 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 378 | 378 | 71 | 0 | 0 | 2997 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.19 | 0.00 | 0.00 | 7.93 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.353 | 10.022 | 0.005 | 0.000 | 0.415 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 309 | 309 | 194 | 0 | 0 | 620 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.63 | 0.00 | 0.00 | 2.01 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.318 | 0.160 | 0.056 | 0.000 | 0.360 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 27 | 0 | 42 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.90 | 0.00 | 1.40 | 0.00 | 0.00 | -0.03 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.036 | 0.174 | 0.000 | 0.312 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 46 | 53 | 0 | 118 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.80 | 0.00 | 1.79 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.007 | 0.080 | 0.174 | 0.000 | 0.345 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 101 | 101 | 77 | 105 | 0 | 252 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.76 | 1.04 | 0.00 | 2.50 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.013 | 0.102 | 0.200 | 0.000 | 0.328 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 93 | 171 | 0 | 420 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 1.26 | 0.00 | 3.09 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.132 | 0.172 | 0.000 | 0.317 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 449 | 449 | 308 | 0 | 0 | 5690 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.69 | 0.00 | 0.00 | 12.67 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.472 | 0.765 | 0.009 | 0.000 | 0.422 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | C | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 403 | 403 | 71 | 0 | 0 | 3084 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.18 | 0.00 | 0.00 | 7.65 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.429 | 10.050 | 0.007 | 0.000 | 0.384 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | B | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 332 | 332 | 239 | 0 | 0 | 663 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.72 | 0.00 | 0.00 | 2.00 | 0.00 | 0.00 | -0.00 | 0.00 |
| time (sec) |
N/A | 0.398 | 0.230 | 0.051 | 0.000 | 0.347 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 27 | 0 | 42 | 0 | 0 | 26 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.90 | 0.00 | 1.40 | 0.00 | 0.00 | 0.87 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.037 | 0.174 | 0.000 | 0.311 | 0.000 | 0.000 | 0.680 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 64 | 64 | 45 | 53 | 0 | 126 | 0 | 0 | 72 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 0.83 | 0.00 | 1.97 | 0.00 | 0.00 | 1.12 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.086 | 0.175 | 0.000 | 0.305 | 0.000 | 0.000 | 0.834 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 98 | 98 | 73 | 105 | 0 | 273 | 0 | 0 | 132 | 0 |
| N.S. |
1 | 1.00 | 0.74 | 1.07 | 0.00 | 2.79 | 0.00 | 0.00 | 1.35 | 0.00 |
| time (sec) |
N/A | 0.016 | 0.105 | 0.171 | 0.000 | 0.322 | 0.000 | 0.000 | 0.960 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 134 | 134 | 95 | 171 | 0 | 457 | 0 | 0 | 209 | 0 |
| N.S. |
1 | 1.00 | 0.71 | 1.28 | 0.00 | 3.41 | 0.00 | 0.00 | 1.56 | 0.00 |
| time (sec) |
N/A | 0.024 | 0.120 | 0.173 | 0.000 | 0.329 | 0.000 | 0.000 | 1.146 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 80 | 80 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.89 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 10.055 | 0.054 | 0.000 | 0.547 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.016 | 10.025 | 0.056 | 0.000 | 0.577 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.021 | 0.059 | 0.000 | 0.576 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 79 | 79 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.90 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.040 | 0.058 | 0.000 | 0.540 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 80 | 80 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.89 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.049 | 0.062 | 0.000 | 0.538 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-1) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 82 | 82 | 79 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.96 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.015 | 10.035 | 0.056 | 0.000 | 0.561 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | B | A | B | B | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 11 | 11 | 11 | 12 | 106 | 17 | 20 | 27 | 11 | 11 |
| N.S. | 1 | 1.00 | 1.00 | 1.09 | 9.64 | 1.55 | 1.82 | 2.45 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.002 | 0.043 | 0.150 | 0.265 | 0.313 | 0.125 | 0.003 | 0.462 | 1.854 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 74 | 73 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.21 | 1.20 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.019 | 0.041 | 0.092 | 0.000 | 0.320 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 110 | 110 | 94 | 389 | 246 | 497 | 4058 | 920 | 478 | 2986 |
| N.S. | 1 | 1.00 | 0.85 | 3.54 | 2.24 | 4.52 | 36.89 | 8.36 | 4.35 | 27.15 |
| time (sec) |
N/A | 0.043 | 0.092 | 0.182 | 0.294 | 0.326 | 2.650 | 0.004 | 0.942 | 15.827 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 78 | 78 | 67 | 159 | 138 | 235 | 1506 | 427 | 226 | 1256 |
| N.S. | 1 | 1.00 | 0.86 | 2.04 | 1.77 | 3.01 | 19.31 | 5.47 | 2.90 | 16.10 |
| time (sec) |
N/A | 0.026 | 0.083 | 0.191 | 0.285 | 0.319 | 0.732 | 0.003 | 0.655 | 6.812 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 46 | 46 | 41 | 49 | 63 | 83 | 377 | 147 | 88 | 383 |
| N.S. | 1 | 1.00 | 0.89 | 1.07 | 1.37 | 1.80 | 8.20 | 3.20 | 1.91 | 8.33 |
| time (sec) |
N/A | 0.014 | 0.045 | 0.146 | 0.273 | 0.328 | 0.436 | 0.003 | 0.484 | 3.043 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 51 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.040 | 0.055 | 0.000 | 0.318 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 52 | 52 | 52 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.042 | 0.061 | 0.000 | 0.322 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 54 | 54 | 54 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.010 | 0.043 | 0.087 | 0.000 | 0.332 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | B | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 111 | 111 | 95 | 386 | 246 | 496 | 4058 | 920 | 478 | 2986 |
| N.S. | 1 | 1.00 | 0.86 | 3.48 | 2.22 | 4.47 | 36.56 | 8.29 | 4.31 | 26.90 |
| time (sec) |
N/A | 0.040 | 0.091 | 0.178 | 0.269 | 0.348 | 1.315 | 0.004 | 0.913 | 16.789 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | A | B | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 78 | 78 | 67 | 159 | 138 | 237 | 1506 | 427 | 226 | 1256 |
| N.S. | 1 | 1.00 | 0.86 | 2.04 | 1.77 | 3.04 | 19.31 | 5.47 | 2.90 | 16.10 |
| time (sec) |
N/A | 0.024 | 0.075 | 0.188 | 0.289 | 0.325 | 0.810 | 0.003 | 0.618 | 6.897 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | B | B | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 41 | 46 | 63 | 83 | 377 | 147 | 88 | 383 |
| N.S. | 1 | 1.00 | 0.87 | 0.98 | 1.34 | 1.77 | 8.02 | 3.13 | 1.87 | 8.15 |
| time (sec) |
N/A | 0.015 | 0.042 | 0.163 | 0.265 | 0.319 | 0.331 | 0.003 | 0.494 | 3.071 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 18 | 18 | 17 | 19 | 18 | 20 | 20 | 16 | 18 | 0 |
| N.S. |
1 | 1.00 | 0.94 | 1.06 | 1.00 | 1.11 | 1.11 | 0.89 | 1.00 | 0.00 |
| time (sec) |
N/A | 0.002 | 0.017 | 0.150 | 0.289 | 0.304 | 0.033 | 0.000 | 0.379 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 51 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.011 | 0.039 | 0.059 | 0.000 | 0.320 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 52 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.02 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.009 | 0.041 | 0.064 | 0.000 | 0.323 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 54 | 54 | 54 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.012 | 0.044 | 0.081 | 0.000 | 0.315 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F | B | F(-2) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 143 | 143 | 112 | 322 | 0 | 512 | 0 | 0 | 528 | 0 |
| N.S. |
1 | 1.00 | 0.78 | 2.25 | 0.00 | 3.58 | 0.00 | 0.00 | 3.69 | 0.00 |
| time (sec) |
N/A | 0.047 | 0.078 | 0.222 | 0.000 | 0.349 | 0.000 | 0.000 | 1.096 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 86 | 86 | 59 | 127 | 0 | 206 | 0 | 0 | 220 | 0 |
| N.S. |
1 | 1.00 | 0.69 | 1.48 | 0.00 | 2.40 | 0.00 | 0.00 | 2.56 | 0.00 |
| time (sec) |
N/A | 0.010 | 0.051 | 0.189 | 0.000 | 0.333 | 0.000 | 0.000 | 0.767 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-2) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 39 | 39 | 36 | 45 | 0 | 60 | 0 | 0 | 102 | 0 |
| N.S. |
1 | 1.00 | 0.92 | 1.15 | 0.00 | 1.54 | 0.00 | 0.00 | 2.62 | 0.00 |
| time (sec) |
N/A | 0.003 | 0.038 | 0.192 | 0.000 | 0.319 | 0.000 | 0.000 | 0.559 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-1) | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 66 | 66 | 65 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.98 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.017 | 0.042 | 0.084 | 0.000 | 0.330 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.018 | 0.035 | 0.078 | 0.000 | 0.323 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 89 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.24 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 0.056 | 0.085 | 0.000 | 0.323 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 92 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.28 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.017 | 0.057 | 0.080 | 0.000 | 0.344 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.024 | 0.036 | 0.073 | 0.000 | 0.326 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-1) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 75 | 75 | 74 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.018 | 0.043 | 0.108 | 0.000 | 0.325 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-2) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 37 | 37 | 38 | 41 | 0 | 59 | 0 | 0 | 97 | 0 |
| N.S. |
1 | 1.00 | 1.03 | 1.11 | 0.00 | 1.59 | 0.00 | 0.00 | 2.62 | 0.00 |
| time (sec) |
N/A | 0.005 | 0.039 | 0.189 | 0.000 | 0.346 | 0.000 | 0.000 | 0.532 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 80 | 80 | 60 | 123 | 0 | 207 | 0 | 0 | 214 | 0 |
| N.S. |
1 | 1.00 | 0.75 | 1.54 | 0.00 | 2.59 | 0.00 | 0.00 | 2.68 | 0.00 |
| time (sec) |
N/A | 0.016 | 0.050 | 0.188 | 0.000 | 0.318 | 0.000 | 0.000 | 0.736 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F | B | F(-1) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 131 | 131 | 113 | 318 | 0 | 509 | 0 | 0 | 525 | 0 |
| N.S. |
1 | 1.00 | 0.86 | 2.43 | 0.00 | 3.89 | 0.00 | 0.00 | 4.01 | 0.00 |
| time (sec) |
N/A | 0.039 | 0.071 | 0.194 | 0.000 | 0.332 | 0.000 | 0.000 | 0.992 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F | B | F(-1) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 186 | 186 | 195 | 661 | 0 | 959 | 0 | 0 | 944 | 0 |
| N.S. |
1 | 1.00 | 1.05 | 3.55 | 0.00 | 5.16 | 0.00 | 0.00 | 5.08 | 0.00 |
| time (sec) |
N/A | 0.067 | 0.091 | 0.211 | 0.000 | 0.334 | 0.000 | 0.000 | 1.642 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 72 | 72 | 71 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.018 | 0.005 | 0.004 | 0.000 | 0.319 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-1) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 75 | 75 | 74 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.020 | 0.046 | 0.087 | 0.000 | 0.328 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-1) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 36 | 36 | 36 | 42 | 0 | 58 | 0 | 0 | 98 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 1.17 | 0.00 | 1.61 | 0.00 | 0.00 | 2.72 | 0.00 |
| time (sec) |
N/A | 0.004 | 0.037 | 0.193 | 0.000 | 0.328 | 0.000 | 0.000 | 0.556 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | B | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 79 | 79 | 59 | 124 | 0 | 205 | 0 | 0 | 214 | 0 |
| N.S. |
1 | 1.00 | 0.75 | 1.57 | 0.00 | 2.59 | 0.00 | 0.00 | 2.71 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.050 | 0.233 | 0.000 | 0.320 | 0.000 | 0.000 | 0.745 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F | B | F(-1) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 130 | 130 | 112 | 319 | 0 | 507 | 0 | 0 | 528 | 0 |
| N.S. |
1 | 1.00 | 0.86 | 2.45 | 0.00 | 3.90 | 0.00 | 0.00 | 4.06 | 0.00 |
| time (sec) |
N/A | 0.033 | 0.073 | 0.244 | 0.000 | 0.334 | 0.000 | 0.000 | 1.023 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | B | F | B | F(-1) | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 185 | 185 | 195 | 662 | 0 | 954 | 0 | 0 | 945 | 0 |
| N.S. |
1 | 1.00 | 1.05 | 3.58 | 0.00 | 5.16 | 0.00 | 0.00 | 5.11 | 0.00 |
| time (sec) |
N/A | 0.049 | 0.091 | 0.233 | 0.000 | 0.341 | 0.000 | 0.000 | 1.609 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-1) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 83 | 83 | 75 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.90 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.066 | 0.084 | 0.000 | 0.333 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-1) | F | F | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 83 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 0.99 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.01 | 0.00 |
| time (sec) |
N/A | 0.022 | 0.059 | 0.076 | 0.000 | 0.314 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 51 | 51 | 51 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.008 | 0.004 | 0.004 | 0.000 | 0.310 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | B | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 53 | 57 | 92 | 93 | 233 | 101 | 46 | 93 |
| N.S. | 1 | 1.00 | 0.93 | 1.00 | 1.61 | 1.63 | 4.09 | 1.77 | 0.81 | 1.63 |
| time (sec) |
N/A | 0.025 | 0.016 | 0.193 | 0.267 | 0.312 | 0.480 | 0.001 | 0.439 | 4.683 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 95 | 95 | 54 | 57 | 0 | 85 | 0 | 0 | 81 | 0 |
| N.S. |
1 | 1.00 | 0.57 | 0.60 | 0.00 | 0.89 | 0.00 | 0.00 | 0.85 | 0.00 |
| time (sec) |
N/A | 0.028 | 0.174 | 0.278 | 0.000 | 0.318 | 0.000 | 0.000 | 1.037 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F | F | B | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 97 | 97 | 46 | 66 | 0 | 84 | 0 | 0 | 119 | 0 |
| N.S. |
1 | 1.00 | 0.47 | 0.68 | 0.00 | 0.87 | 0.00 | 0.00 | 1.23 | 0.00 |
| time (sec) |
N/A | 0.017 | 0.251 | 0.204 | 0.000 | 0.321 | 0.000 | 0.000 | 2.138 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | F | A | F(-1) | F | B | F(-1) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 97 | 97 | 46 | 66 | 0 | 84 | 0 | 0 | 142 | 0 |
| N.S. |
1 | 1.00 | 0.47 | 0.68 | 0.00 | 0.87 | 0.00 | 0.00 | 1.46 | 0.00 |
| time (sec) |
N/A | 0.015 | 0.122 | 0.208 | 0.000 | 0.359 | 0.000 | 0.000 | 0.850 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 30 | 30 | 30 | 0 | 0 | 0 | 29 | 0 | -1 | 28 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.97 | 0.00 | -0.03 | 0.93 |
| time (sec) |
N/A | 0.006 | 0.057 | 0.059 | 0.000 | 0.316 | 1.305 | 0.000 | 0.000 | 2.782 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 35 | 0 | 0 | 0 | 31 | 0 | -1 | 29 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.89 | 0.00 | -0.03 | 0.83 |
| time (sec) |
N/A | 0.005 | 0.058 | 0.051 | 0.000 | 0.336 | 1.285 | 0.000 | 0.000 | 2.783 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 33 | 33 | 33 | 0 | 0 | 0 | 37 | 0 | -1 | 27 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 1.12 | 0.00 | -0.03 | 0.82 |
| time (sec) |
N/A | 0.006 | 0.073 | 0.051 | 0.000 | 0.363 | 77.086 | 0.000 | 0.000 | 52.351 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 37 | 37 | 37 | 0 | 0 | 0 | 42 | 0 | -1 | 30 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 1.14 | 0.00 | -0.03 | 0.81 |
| time (sec) |
N/A | 0.005 | 0.074 | 0.050 | 0.000 | 0.323 | 76.091 | 0.000 | 0.000 | 52.445 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | C | F | F | C |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 47 | 47 | 47 | 0 | 0 | 0 | 42 | 0 | -1 | 41 |
| N.S. | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 0.89 | 0.00 | -0.02 | 0.87 |
| time (sec) |
N/A | 0.012 | 0.028 | 0.057 | 0.000 | 0.311 | 19.800 | 0.000 | 0.000 | 16.337 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | F | F | F | F(-2) | F | F | F(-2) |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 45 | 45 | 88 | 0 | 0 | 0 | 0 | 0 | -1 | 0 |
| N.S. |
1 | 1.00 | 1.96 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -0.02 | 0.00 |
| time (sec) |
N/A | 0.014 | 0.022 | 0.092 | 0.000 | 0.316 | 0.000 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 28 | 28 | 28 | 23 | 22 | 22 | 22 | 25 | 22 | 20 |
| N.S. | 1 | 1.00 | 1.00 | 0.82 | 0.79 | 0.79 | 0.79 | 0.89 | 0.79 | 0.71 |
| time (sec) |
N/A | 0.004 | 0.000 | 0.013 | 0.272 | 0.295 | 0.030 | 0.000 | 0.037 | 1.679 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 15 | 12 | 11 | 11 | 8 | 14 | 10 | 10 |
| N.S. | 1 | 1.00 | 1.00 | 0.80 | 0.73 | 0.73 | 0.53 | 0.93 | 0.67 | 0.67 |
| time (sec) |
N/A | 0.002 | 0.000 | 0.013 | 0.258 | 0.292 | 0.046 | 0.000 | 0.021 | 1.677 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 11 | 11 | 11 | 10 | 9 | 9 | 5 | 9 | 8 | 9 |
| N.S. | 1 | 1.00 | 1.00 | 0.91 | 0.82 | 0.82 | 0.45 | 0.82 | 0.73 | 0.82 |
| time (sec) |
N/A | 0.001 | 0.000 | 0.012 | 0.256 | 0.294 | 0.029 | 0.000 | 0.017 | 1.600 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 9 | 9 | 9 | 10 | 9 | 9 | 7 | 11 | 7 | 7 |
| N.S. | 1 | 1.00 | 1.00 | 1.11 | 1.00 | 1.00 | 0.78 | 1.22 | 0.78 | 0.78 |
| time (sec) |
N/A | 0.001 | 0.000 | 0.012 | 0.337 | 0.287 | 0.028 | 0.000 | 0.029 | 1.609 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 14 | 14 | 14 | 15 | 12 | 12 | 10 | 15 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 1.07 | 0.86 | 0.86 | 0.71 | 1.07 | 0.86 | 0.86 |
| time (sec) |
N/A | 0.002 | 0.000 | 0.038 | 0.273 | 0.292 | 0.035 | 0.000 | 0.020 | 1.635 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 11 | 11 | 11 | 10 | 9 | 9 | 8 | 15 | 10 | 10 |
| N.S. | 1 | 1.00 | 1.00 | 0.91 | 0.82 | 0.82 | 0.73 | 1.36 | 0.91 | 0.91 |
| time (sec) |
N/A | 0.001 | 0.000 | 0.011 | 0.257 | 0.289 | 0.028 | 0.000 | 0.019 | 1.654 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 15 | 12 | 11 | 11 | 8 | 17 | 8 | 8 |
| N.S. | 1 | 1.00 | 1.00 | 0.80 | 0.73 | 0.73 | 0.53 | 1.13 | 0.53 | 0.53 |
| time (sec) |
N/A | 0.001 | 0.000 | 0.013 | 0.266 | 0.291 | 0.050 | 0.000 | 0.021 | 1.614 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 18 | 18 | 18 | 15 | 14 | 14 | 15 | 19 | 13 | 13 |
| N.S. | 1 | 1.00 | 1.00 | 0.83 | 0.78 | 0.78 | 0.83 | 1.06 | 0.72 | 0.72 |
| time (sec) |
N/A | 0.002 | 0.000 | 0.014 | 0.299 | 0.292 | 0.028 | 0.000 | 0.024 | 1.636 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 20 | 20 | 20 | 17 | 16 | 16 | 12 | 21 | 15 | 14 |
| N.S. | 1 | 1.00 | 1.00 | 0.85 | 0.80 | 0.80 | 0.60 | 1.05 | 0.75 | 0.70 |
| time (sec) |
N/A | 0.002 | 0.000 | 0.007 | 0.289 | 0.299 | 0.027 | 0.000 | 0.026 | 1.654 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 16 | 16 | 16 | 13 | 12 | 12 | 10 | 17 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.81 | 0.75 | 0.75 | 0.62 | 1.06 | 0.75 | 0.75 |
| time (sec) |
N/A | 0.001 | 0.000 | 0.013 | 0.268 | 0.321 | 0.030 | 0.000 | 0.023 | 1.634 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 13 | 13 | 13 | 14 | 13 | 13 | 12 | 25 | 13 | 11 |
| N.S. | 1 | 1.00 | 1.00 | 1.08 | 1.00 | 1.00 | 0.92 | 1.92 | 1.00 | 0.85 |
| time (sec) |
N/A | 0.001 | 0.000 | 0.012 | 0.260 | 0.298 | 0.028 | 0.000 | 0.028 | 1.619 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 22 | 21 | 20 | 27 | 20 | 23 | 20 | 20 |
| N.S. | 1 | 1.00 | 1.00 | 0.95 | 0.91 | 1.23 | 0.91 | 1.05 | 0.91 | 0.91 |
| time (sec) |
N/A | 0.003 | 0.005 | 0.012 | 0.253 | 0.298 | 0.115 | 0.000 | 0.037 | 1.750 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 22 | 22 | 22 | 17 | 16 | 17 | 15 | 20 | 17 | 17 |
| N.S. | 1 | 1.00 | 1.00 | 0.77 | 0.73 | 0.77 | 0.68 | 0.91 | 0.77 | 0.77 |
| time (sec) |
N/A | 0.002 | 0.001 | 0.014 | 0.281 | 0.292 | 0.044 | 0.000 | 0.029 | 1.704 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 15 | 14 | 13 | 17 | 14 | 14 | 11 | 13 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.87 | 1.13 | 0.93 | 0.93 | 0.73 | 0.87 |
| time (sec) |
N/A | 0.002 | 0.002 | 0.008 | 0.281 | 0.295 | 0.049 | 0.000 | 0.029 | 1.659 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 10 | 10 | 10 | 11 | 10 | 11 | 7 | 10 | 10 | 10 |
| N.S. | 1 | 1.00 | 1.00 | 1.10 | 1.00 | 1.10 | 0.70 | 1.00 | 1.00 | 1.00 |
| time (sec) |
N/A | 0.002 | 0.002 | 0.012 | 0.258 | 0.294 | 0.045 | 0.000 | 0.033 | 1.630 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 15 | 12 | 11 | 12 | 10 | 16 | 12 | 12 |
| N.S. | 1 | 1.00 | 1.00 | 0.80 | 0.73 | 0.80 | 0.67 | 1.07 | 0.80 | 0.80 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.016 | 0.260 | 0.309 | 0.049 | 0.000 | 0.025 | 1.641 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 11 | 11 | 11 | 10 | 9 | 9 | 8 | 11 | 9 | 9 |
| N.S. | 1 | 1.00 | 1.00 | 0.91 | 0.82 | 0.82 | 0.73 | 1.00 | 0.82 | 0.82 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.012 | 0.260 | 0.304 | 0.043 | 0.000 | 0.027 | 1.610 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 13 | 13 | 13 | 12 | 11 | 10 | 8 | 14 | 10 | 10 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.85 | 0.77 | 0.62 | 1.08 | 0.77 | 0.77 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.010 | 0.274 | 0.293 | 0.053 | 0.000 | 0.031 | 1.630 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 13 | 13 | 13 | 12 | 11 | 11 | 10 | 17 | 11 | 11 |
| N.S. | 1 | 1.00 | 1.00 | 0.92 | 0.85 | 0.85 | 0.77 | 1.31 | 0.85 | 0.85 |
| time (sec) |
N/A | 0.002 | 0.001 | 0.010 | 0.264 | 0.309 | 0.041 | 0.000 | 0.026 | 1.629 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 17 | 12 | 11 | 11 | 12 | 20 | 11 | 11 |
| N.S. | 1 | 1.00 | 1.00 | 0.71 | 0.65 | 0.65 | 0.71 | 1.18 | 0.65 | 0.65 |
| time (sec) |
N/A | 0.002 | 0.001 | 0.039 | 0.255 | 0.312 | 0.031 | 0.000 | 0.030 | 1.683 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 13 | 13 | 13 | 10 | 9 | 9 | 10 | 20 | 8 | 9 |
| N.S. | 1 | 1.00 | 1.00 | 0.77 | 0.69 | 0.69 | 0.77 | 1.54 | 0.62 | 0.69 |
| time (sec) |
N/A | 0.001 | 0.001 | 0.169 | 0.281 | 0.301 | 0.038 | 0.000 | 0.024 | 1.602 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 14 | 10 | 9 | 10 | 12 | 21 | 10 | 10 |
| N.S. | 1 | 1.00 | 0.93 | 0.67 | 0.60 | 0.67 | 0.80 | 1.40 | 0.67 | 0.67 |
| time (sec) |
N/A | 0.001 | 0.008 | 0.023 | 0.271 | 0.306 | 0.040 | 0.000 | 0.021 | 1.639 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 15 | 14 | 13 | 18 | 14 | 19 | 15 | 13 |
| N.S. | 1 | 1.00 | 1.00 | 0.93 | 0.87 | 1.20 | 0.93 | 1.27 | 1.00 | 0.87 |
| time (sec) |
N/A | 0.002 | 0.014 | 0.046 | 0.261 | 0.294 | 0.032 | 0.000 | 0.291 | 1.639 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 17 | 17 | 14 | 12 | 11 | 10 | 14 | 22 | 12 | 10 |
| N.S. | 1 | 1.00 | 0.82 | 0.71 | 0.65 | 0.59 | 0.82 | 1.29 | 0.71 | 0.59 |
| time (sec) |
N/A | 0.001 | 0.012 | 0.026 | 0.262 | 0.358 | 0.030 | 0.001 | 0.027 | 1.681 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 15 | 15 | 10 | 12 | 11 | 14 | 12 | 28 | 8 | 8 |
| N.S. | 1 | 1.00 | 0.67 | 0.80 | 0.73 | 0.93 | 0.80 | 1.87 | 0.53 | 0.53 |
| time (sec) |
N/A | 0.001 | 0.008 | 0.044 | 0.276 | 0.318 | 0.031 | 0.001 | 0.027 | 1.620 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 24 | 24 | 24 | 17 | 16 | 14 | 19 | 28 | 15 | 16 |
| N.S. | 1 | 1.00 | 1.00 | 0.71 | 0.67 | 0.58 | 0.79 | 1.17 | 0.62 | 0.67 |
| time (sec) |
N/A | 0.002 | 0.004 | 0.025 | 0.263 | 0.300 | 0.032 | 0.000 | 0.029 | 1.645 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | Mathics | |
| grade |
A | A | A | A | A | A | A | A | B | A |
| verified |
N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
| size | 23 | 23 | 23 | 16 | 15 | 19 | 20 | 31 | 17 | 15 |
| N.S. | 1 | 1.00 | 1.00 | 0.70 | 0.65 | 0.83 | 0.87 | 1.35 | 0.74 | 0.65 |
| time (sec) |
N/A | 0.002 | 0.005 | 0.045 | 0.254 | 0.304 | 0.033 | 0.000 | 0.281 | 1.635 |